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ABSTRACT 


As recognized in the software engineering process, software testing during develop- 
ment is an aspect that must be improved to accurately predict and reduce probabilities of 
future software failures. A possible method of improving software reliability is to concen- 
trate on the scheduling of the test process to reduce costs and increase coverage. 

Software test scheduling is the process of sequencing the test procedures to manage 
costs and maximize verification and validation of the system being evaluated. Changing the 
methodologies of software testing by implementing a scheduling process can affect many 
issues in software testing. Software testing is an evolutionary process; to be effective, the 
test scheduling problem and solution must be continuously revisited, revised and permitted 
to change according to the events as they occur. This implies that the test scheduling 
solution is dependant upon many factors, including software design model, results of 
previous test(s), and the time and resources available for further testing. This empirical 
study takes the testing information from a Published Specification and performs a detailed 
analysis of a scheduled solution. Based on the results of this work, it has been determined 
that the work and resources required to design and develop a software test schedule 


outweigh the resulting benefits. 
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I. BACKGROUND AND RELATED RESEARCH 


A. INTRODUCTION 

Computer involvement in our daily lives is becoming more common and complex. 
Computer systems have become accepted by society as necessary for improved quality 
assurance and safety where the potential for loss of life exists. The impact of these largely 
ignored systems and their associated influence are generally unnoticed until something 
goes wrong [BOLC 90]. These complex systems require improved verification and 
validation through software testing to reduce the probability of failure and prevent losses 
in productivity or human life. 

The process of testing software, is an activity in which a system or component is 
executed under specified conditions, the results are observed or recorded, and an evaluation 
is made of some aspect of the system or component [IEEE 91]. As recognized in the 
software engineering process, software testing during development is an aspect that must 
be improved to accurately predict and reduce probabilities of future software failures. At 
issue is how to prevent or circumvent system failure and increase reliability through 
improved software test scheduling and design. A possible method of improving software 
reliability is to concentrate on the scheduling of the test process to reduce costs and increase 


coverage. 


The purpose of software testing is to eliminate faults. Therefore, the only successful 
test 1s one that finds a software fault [MYER 79]. Software test scheduling is the process 
of sequencing the test procedures to manage costs and maximize verification and validation 
of the system being evaluated. Changing the methodologies of software testing by 
implementing a scheduling process can affect many issues in software testing. Specifically, 
once software tests are to be sequenced. how does one solution impact the selection of the 
next test or series of tests; at what point does a successful test influence the selection of the 
follow-on or remaining tests to completion of product testing? These issues are important 
to continued validity of the test schedule during the testing process since once scheduling 
of tests is initiated, continued updating and modification of the test schedule is necessary. 
Software testing is an evolutionary process; to be effective, the test scheduling problem and 
solution must be continuously revisited, revised and permitted to change according to the 
events as they occur. This implies that the test scheduling solution is dependant upon many 
factors, including software design model, results of previous test(s), and the time and 
resources available for further testing. These factors will be addressed as the process of test 


scheduling is studied. 


B. BACKGROUND 
There are few existing references to software test scheduling. Previous work has 
concentrated on the automation of the quality control activities in software development. 


In automatic software test generation, the functional specification identifies the areas that 


must be validated. This allows the development phase and test preparation to be performed 
concurrently [CAMU 90]. 

The cost of verification and validation activities can be high, meeting and perhaps 
exceeding 50% of the overall expenses of the project [CAMU 90]. This places increased 
pressure on the software test team to identify and locate the maximum number of system 
errors and faults during the testing phase. The test teams are finding that they must do more 
with less due to these increasing pressures. Due to the changes taking place in the test 
phase, current and historical information is more valuable than ever. Information and data 
must be gathered and retained so as much information as possible is available for improved 
referencing in test scheduling. 

Despite the fact that testing during the development phase is recognized as a critical 
aspect of the software engineering process, resources remain limited in the testing phase. 
The resources, including personnel, software tools and computing time and hardware must 
be shared throughout the development process. Thus testing must become an exact 
discipline to prevent management from considering it a necessary evil to product 
development. By scheduling the test process, testers may be able to improve effectiveness 


through increased efficiency and as a result, reduce verification and validation costs. 


C. SOFTWARE TEST GENERATION 
1. General 

There continues to be an extensive amount of research devoted to the study of 
software testing. Software test methods are designed according to the current stage in the 
software life cycle; test methods or processes include specification, design and code 
reviews, walkthroughs, inspections, etc., to full product acceptance testing. Testing 1s an 
unavoidable function of the development process; software testing is the only way to 
demonstrate that the program performs as designed and specified. 

The concept of scheduling is based on the premise that by isolating behaviors, 
common procedures and functions we can improve verification. To provide the best 
coverage, values are represented as a class (behavior, shared property or process) and it is 
assumed that the routine will run correctly for other values in the class, when the related 
test has been correctly executed. 


In this implementation, a test is composed of: 

* a Set of data to exercise a program. 

¢ a Set of expected results from its execution. 

¢ a mechanism (programs, rules given to humans, etc.) to carry the system under test in 
a predefined state, to submit input data, and to collect output results. 

¢ a mechanism (programs, rules given to humans, etc.) to compare actual results with 
expected ones. 

¢ a description of test scope, that is, the list of ‘elements’ (behavior of program physical 
entities of ‘elements’ such as variables or control paths, etc.) on which the test has 
focused [CAMU 90]. 


Based on these definitions, tests can be classified as either positive or negative, or 


functional or structural tests. 





a. Positive / Negative Tests 

A positive test checks that a program works correctly when correctly used 
(i.e., when the input set of data are provided correctly and in the proper format). These tests 
verify that the program executes to the set of expected results. The scope of a positive test 
is to verify the program performs correctly when given correct inputs. 

A negative test checks that a program works correctly when misused, Le., 
that incorrect inputs (values or formats) are recognized, discarded, and signaled and no 
crashes or damage occur [CAMU 90]. Negative tests verify that the program recognizes an 
incorrect set of data and performs as designed. The scope of negative testing is to ensure 
incorrect conditions generated outside of the tested environment are correctly handled. 

b. Functional / Structural Tests 

In functional program testing, the design of a program is viewed as an abstract 
description of its design and requirements specifications. Function and data abstractions are 
used as guides to identify the abstract functions of a program and to generate the functional 
test data [DEMI 87]. A functional test checks that the item functions properly when 
provided to the user. 

Structural testing refers to the generation of test data to evaluate each part of 
the structure of the software. The input set of data is designed to manipulate the program 
from a structural perspective; a structural test exercises physical parts of the program. A 


program is working correctly when executing a specific control path. 


2. Testing Methods 


It has been observed that the later an error has been detected, the more 
expensive it is to correct. This observation encourages testing early in the development 
of software [DEMI 87]. 


In order to increase validation and verification, testing begins in requirements 
analysis and continues throughout the software systems operational utility. The methods 
used in evaluation are implemented and evaluated differently with different goals. The 
ability to apply the scheduling methodology to any of the development testing strategies is 
important to ensuring complete applicability of the test scheduling process. The remainder 
of this section concentrates on the test methods in the development process, their 
applicability to our definition of a test and how scheduling these processes may influence 
the result. 

a. Test Methods Related to Requirements Analysis 

Requirements documents have historically been the most poorly “tested” 
work products in the development cycle [HETZ 88]. This seems contradictory to the 
premise that the requirements documents are the foundation for the development of the 
software product in the first place. Traditionally, the requirements are analyzed using a 
checklist of correctness conditions, including such properties of requirements as 
consistency, their necessity to achieve the goals of the system, and the feasibility of their 
implementation with existing resources[DEMI 87]. 

Testing requirements involves answering two basic questions: Are any of the 


requirements missing and can any of the requirements be simplified or eliminated [HETZ 


— 


88]. In requirements analysis the data to be tested or evaluated are the issues raised in the 
specifications of the requirements documentation. Each requirement of the software must 
be considered for their applicability to achieve the software systems’ purpose for 
development. The expected result of evaluating the requirements documents is to 
determine whether they have specifically meet the definition of the users needs in the 
product specification, while minimizing resources, overhead, cost, and maximizing 
efficiency and productivity in the software and its development. 

The methods used in requirements vary from checklists designed for 
structural reviews and walkthroughs to automated static checking and verification tools. 
Thus, the scope of requirements testing is process specific; the scope of requirements 
testing is based on the desires of the user. This may be the reason requirements have 
historically been the most poorly “tested” work products. 

When properly tested and evaluated, the requirements documents can have a 
much greater influence in the developments process. If the requirements documents have 
been evaluated (tested) and are relied upon in development, the design of final system 
acceptance tests based on the requirements can be initiated in the requirements analysis 
phase. These initial acceptance tests will remain tentative until the final specification 
version is understood and comprehendible, but their usefulness in understanding the 
required final product behavior can be important the development processes of the follow- 


on stages. 


b. Test Methods Related to Functional Specification (Requirements 
Definition Phase) 

The elements of a software system specification can be analyzed similar to 
the one used in requirements analysis. Each property specified in the checklist may be 
checked by a methods similar to those in the requirements analysis, based on the detailed 
requirements definition and the approved functional software specification. 

The data to exercise the process are the requirements specification. The 
requirements definition phase is expected to determine the exact processes necessary to 
meet the specifics of the documentation. The mechanisms used to perform this process 
include formal and informal methods. 

Initial logic testing can begin to determine proof of correctness of specified 
items of interest, critical logical concepts and areas of undeveloped, proposed functionality. 
These are useful in evaluating software reliances and module pre-requisites. Formal 
proving or proof of correctness of the software system is extremely difficult and in many 
instances, impossible. However, the formal proof of correctness of any module can be 
influential in the design process and can reduce the testing requirements of related software 
modules; a module formally proven to be correct ensures reliability and reduces the need 
for it’s module testing. Once a module is formally proven the testing emphasis can be 
shifted to the calling modules and thus reduces the testing requirements. 

The purpose of this phase is to derive requirements-based test situations and 


use them as a test of requirement understanding and validation. In this process, the scope is 


not limited to the specified system and software requirements. The requirements definition 
phase is not limited to preclude concluding prematurely. Upon completion of the testing 
and evaluation of the functional specification phase, it is anticipated that the modules have 
been verified to prevent incorrect implementation in the design phases. If the process is 
scheduled, it may improve module coverage by sequencing the requirements based on pre- 
requisite processing. 

c. Test Methods Related to Architectural Design 

The issues related to software reusability are relevant in the design phase. 
Concepts that have been previously tested, verified or proved can be applied wherever 
possible. In circumstances in which this is not possible every effort must be made to utilize 
reusability in the development of new software designs. 

The best management tool that can be employed during this phase is the 
structured walkthrough, which seeks to make the design process even more visible and 
hopefully leads to a more understandable product. The design phase should initiate 
development of the integration testing topics and issues. The integration testing phase is 
dependent upon the reasoning and issues used in the design process. These issues are 
directly related to the product integration and are more easily understood at this 
development stage than any other. This knowledge influences the development of the test 
procedures; at this stage the designers have full comprehension of the requirements and 
what is necessary for specification validation. The data sets and expected results are easily 


outlined and the generation of the testing mechanisms to carry the system can be developed 


in parallel with system design. Architectural design can have a major influence in the test 
development process due to the level of specification understanding necessary. The 
designers impact on the testing mechanisms can include the data set selection, set of 
expected results, the system test process and the description of the test scope. Architectural 
design is the single most phase having the greatest influence on the test development 
process. 

Scheduling of the issues relevant to architectural design are important due to 
the descriptive nature of the evaluation results. The design is evaluated during 
development, and tested as completed sub-units and as whole packages. The module 
information provides the relevant pre-requisite data for scheduling of implementation and 
system test design and test processing. 

d. Test Methods Related to Implementation 


Traditionally, coding begins after the completion of the design phase and 
ends at some arbitrary point. In some ways coding does not end untl the software is 
abandoned. The goal of implementation are to provide, justify, and verify a realization 
for each module [BERZ 91]. 


Most testing associated with the implementation phase is performed at the 
programmers level [DEMI 87]. Hence, much of the testing performed at the 
implementation level is desktop or programmer walkthrough. 

Implementation testing is what many people consider the most important 
phase in the testing process. The data used in the testing is designed to execute the code to 


reach every solution designed to be met, reach values outside of the specified ranges, 
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perform an incorrect sequence of operations or fail to determine a correct solution based on 
the inputs, etc. In addition to verifying how the software processes, the implementation 
tests are designed to help locate and change any incorrectly implemented procedures, 
functions or modules. 

Additional testing developed for implementation recognizes that this phase is 
the installation of the system and requires evaluation of performance based on the 
description of the internal structure of each module specified in the design phase [DEMI 
87]. This implies that continued development of the integration testing platform is 
continuous. The implementation phase can point to problems or difficulties related to the 
generation of algorithms and data structures. These problems or difficulties must be 
considered in the continued development of the module, integration and acceptance test 
cases. 

Scheduling in the implementation phase is dependant on the design issues and 
the progression of the development cycle. During implementation, the schedule of the 
modules tested is more dependent on the evolution of coding than anything else. However, 
the implementation phase provides scheduling input information for the system testing 
process. 

e. Test Methods Related to Installation/Evolution 

Software changes made after implementation are more error prone than the 

initial development, and require more attention to quality assurance techniques at every 


stage. This is why proper documentation of every phase of test planning development and 


11 


implementation is emphasized. Testing in the software evolution phase is more easily 
performed if the original and subsequent change testing documentation is available. In the 
instances in which information and data 1s available, the testing process becomes a follow- 
on phase adapted from previous work, exercises and data. In the event no previous work 
exists, the testing process must be developed to meet cost verses benefit considerations. 
In installation or evolution testing, the data used to exercise the program is 
designed to specifically exercise a certain process, function or module. While the results of 
this testing are predetermined, the evaluation of secondary effects within the system must 
be performed. The testing of an existing software system is much more difficult than 
developing and implementing the test program in the software development process. The 
limitations and pressures in place preclude “starting from scratch”. Thus, the test team must 
consider every effect the changes can have on the system. This complex and detailed 
procedure requires that the testing process be performed in a tighter and more confined 
arena, on a much smaller scale, while providing the same level of quality assurance as a 
complete product development test process performed over the development life of the 


software system. 


D. MODEL OF SOFTWARE TESTING 
Software testing has been modeled as a sampling or approximation-of-exhaustion 
problem, where the concern has been to extensively sample from an identified set of 


portions of the software’s internal topology or behavior. We seek to model the generic task 


12 


of software testing, preparatory to examining the effect of scheduling strategies on the task 
of testing software. In general, the task of software testing has two goais: 
¢ to demonstrate the most important behaviors of the software; 
¢ to identify the behaviors of the software that are considered faulty; 
Based on theses two goals, given a program, represented as a set of behaviors 


B= {bo 5,, 5, ...b,}, and a set of tests T = {t 


aac. 


eee eet 
¢ A real-valued function, s(bp), indicating the cost of program test initialization and 


start-up, resulting in the test starting behavior Do. 
* A real-valued function, c(b,, b;), indicating the cost of f; fe the transition from the i" 


observable behavior to the pa observable behavior (note, this includes instrumentation 
Costs, execution costs and re-initialization or setup costs); 


¢ A real-valued function, c(b,), indicating the cost of observing b F (note, this includes 


the initiation cost when applicable, required resources, instrumenting, collecting 
results, result comparison, judging results, and the cost of evaluating the test oracle on 
b,); 
¢ A boolean-valued function i(b,), indicating if b; is an behavior requiring observation 
and evaluation as stipulated by the test team; 
find the total evaluation, initiation, test and transition cost from each combination of 


observable behaviors and test processes. This model is designed to represent the process of 


determining test scheduling costs, and is the basis of the scheduling tool development. 
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E. PROBLEM DESCRIPTION 

Testing of any software system is a formidable challenge. The purpose of this study is 
to isolate the scheduling problem and show how this impacts the testing strategy. The goal 
is to develop a strategy and an analysis tool in which test scheduling can be analyzed to 
determine whether a scheduled testing strategy can reduce the cost of software testing. 


The end result of this study is to determine the influence of scheduling on the test process. 


F. OVERVIEW OF THE THESIS 

While there has been extensive research in the area of software testing and automatic 
software test generation, test scheduling has not been considered. There is little research 
aimed at examining the impact of scheduling on improving test coverage, validation and 
verification and reducing test expenses. This first chapter has provided an introduction to 
the concepts of test scheduling. The remainder of this thesis will deal with the design of a 
scheduling tool, generation of the input data set for analysis and measurement and analysis 
of the scheduling data results. 

Chapter II is a detailed description of the scheduling tool design and implementation. 
It includes the description of the input format of the scheduling tool as well as information 
on the operations performed on the tool input data set. 

Chapter III is a description of the data set to the scheduling tool and a presentation of 
the results. This includes a detailed description, discussion and evaluation of the expected 


and actual results. All observations made in the development of the scheduling tool, input 


test data set and analysis data will be presented. These observations are presented with 
regard to their effect on test scheduling and the software test process. 

The focus of Chapter IV is the effect of the conclusions drawn in Chapter III and rec- 
ommendations developed based upon the findings of this effort. Included is a discussion of 


recommendations for future research: to improve the software testing process. 








If. SOFTWARE TEST SCHEDULE ANALYSIS TOOL 


The process of scheduling tests and the development of test data begins in the system 
analysis and design process. What is tested and the approach used to ensure adequate 
coverage is determined using a combination of heuristics, historical information and the 
test teams’ experience. 

This chapter describes the design and implementation of the test scheduling tool with 
an emphasis on the test development concepts related to scheduling. The purpose of the test 
scheduling tool is assist in the evaluation of completing an in-depth schedule or ordering of 


the software tests throughout development, including the test and analysis phase. 


A. TOOL OVERVIEW 

The scheduling tool is developed using AYACC [TABA 88], [NGUY 88] to parse the 
input data (See Appendix A), and build a graph representation using a reusable software 
graph package [BOOCH 87] (See Appendix B). Most important to the scheduling tool is 
the representation of the test data and information as elements of a directed acyclic graph. 
Once the directed acyclic graph is created and initialized with the input data, separate 


software is used to perform graph transitions to generate a solution set. 
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B. TOOL DESCRIPTION 

In the development of the scheduling tool, several definitions and descriptions must 
first be resolved. The program and its tests are represented as a collection of observable 
behaviors and data evaluation procedures called test procedures. A graph model is used to 
represent a collection of test procedures as a testing process. The test process is the set of 
all tests designed to verify or validate a module or data set of the software system. The 
collection of all test procedures is the software test plan. The directed acyclic graph is a 
representation of observable behaviors as nodes and test procedures as arcs to delineate the 
possible test schedule paths. The graph data structure permits many combinations of test 


procedures to be represented simultaneously. 


C. TOOL IMPLEMENTATION 
The scheduling tool requires the directed acyclic graph to maintain the testing 
behaviors and test pre-requisites in a logical and easily understood structure. (See Figure 
2.1). The graph data structure was designed using reusable software (See Appendix C) that 
permits easy modification, traversal and information access of the graphical elements. The 
following section describes in detail the tool implementations and data representation. 
1. Graph Description 
The nodes in the graph are a representation of observable behaviors. Each arc is 
a test procedure signifying the transition of data from one observable behavior to one or 


more others. All behaviors and tests are uniquely represented and identifiable. Each 
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observable behavior has a unique identification number, evaluation cost, initiation cost and 


importance indicator. The test procedures are identified by an integer identification number 
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and the list of the nodes connected, annotated by the cost cf each transition. The node and 
arc structures are described as follows: 
a. Node Information 

The node is a representation of the requirement behavior. The following are 
the characteristics of the node data structure. 

(1) Node Identification: The identification number is assigned by the test 
team. It is an indicator used to sequence the nodes and provide a reference label. 

(2) Node Cost: The cost represents the reduction against the total allowed to 
perform the test procedure. The cost is a value that can give the user a measurement of 
progress against the total units allocated. 

The node cost is composed of two element values: Evaluation and Initiation 
cost. The inputs to each of the values is different and their summation is not a single 
representative value useful in this implementation; the evaluation and initiation costs have 
different purposes and utilizations. The cost variable is designed for use by multiple test 
procedures. Once the costs have been accrued by the test procedure there is no associated 
cost to remain in any State, stationary or otherwise. 

(a) Evaluation Cost: In every instance of an observable behavior there 
is an evaluation cost. The node evaluation cost is the representation of the resources 
required to evaluate the observable behavior. The evaluation cost is represented as a single 
comprehensive value; the evaluation cost is a measure of the work and resources required 


to verify the process was completed, the results meet the post-condition requirements and 
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determine if the test case is (was) correctly implemented. Assumptions made in the design 
of the graph representation relate to initialization and completion of evaluation processes. 
Starting cases are assumed to have a built-in allowance for any initialization or start-up 
requirement costs. In all ending test cases, the comprehensive procedure evaluation cost is 
subsumed by the node evaluation cost. 

Each case of a test procedure has different associated costs; each of the 
costs is an estimate of the cost of collecting results to analyze the data and the cost of 
judging these results. The cost of collecting results is proportional to the size and frequency 
of the views of the observable behavior or condition. The cost of judging the data is directly 
related to the number of data comparisons necessary for evaluation. 

(b) Initiation Cost: In a directed acyclic graph, any node can be the starting 
node. Because of this, each node has an initiation cost that is a measure of the resources 
required to begin a test procedure from that state. This is the cost associated with starting in 
a state other than an identified start state having no pre-requisite requirements. 

(3) Importance Factor: In every sequencing system, certain processes have higher 
priorities for completion. The test cases having higher priorities in the test procedures are 
so indicated by a boolean importance indicator. The indicator is initialized to false in the 
input data set. After initialization, the graph is traversed and a graph of only test cases 
having a positive importance indicator is created called the importance graph. The 
importance graph is a reference graph of test cases requiring completion and evaluation. 


This graph is the launch point for graph expansion and data generation. 
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b. Arc Information 
An arc in the graph is a representation of a test procedure. The test procedure 
is the activity in which a system or component is executed under specified conditions. Each 
arc represents the execution activity and the transition from one observable behavior to 
another. 

(1) Arc Identification: Similar to the node identification element, each arc has a 
unique identification number. The identification number is a reference integer used to 
sequence the arcs and provide an address label. Each arc is numbered based on the integer 
identification numbers of the adjacent source and destination nodes of the test procedure in 
the input set; the arc identification number is the concatenation of the source and 
destination node identification numbers. In addition to the arc number the arcs have a 
identification sub-number used as a link to the test procedure reference number. The test 
procedure number is the test identification number given as an input variable. The arcs have 
two identifiers to allow multiple traversals from one test case to another under differing 
circumstances. This allows for zero or more arcs between any two nodes. 

(2) Arc Cost: The transition cost from one test case to another is the arc weight 
or cost. The arc cost is a representation of the functionality relative to a transition from one 
test case to another. This is the representative cost of execution of the test procedure. The 
change of state is the change in the data being processed in the test plan. The test procedure 
cost is an estimate based on the complexity of the issues and data. The arc cost is also a 


reduction against the resources available to complete the test plan. 
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2. Example Graph Implementation 

The example graph below demonstrates the node and arc adjacencies. (See Figure 
2.2.) In this example there are six nodes (test cases) and seven arcs (test procedures). In 
addition, there are four test processes as follows: 132, 135, 146, 25. These process paths 
can be reviewed while traversing from unit to unit. The two arcs between nodes | and 3 are 
from different test processes (paths). Each has the same arc identification, but different test 
identifications to allow accurate cost generation. 

The solid circled nodes indicate those states in which it is important for the testing 
phase to transition through (important nodes). These states could be considered failure 


points in the test phase; if it is not possible to reach the important units (minimal graph), 





Figure 2.2 Sample Tool Graph 
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the test phase cannot be completed. In this case either the limit must be modified or the 
costs must be adjusted. 

Based on these descriptions it is apparent that the total cost of any one test 
procedure is the summation of the costs of the nodes and the associated arcs traversed. Thus 


the total cost of the test plan is the compilation and summation of all test procedure costs. 


D. TOOL SOLUTIONS 

The purpose of the scheduling tool is to model the task of software testing, to assist in 
examining the effect of scheduling strategies and their related costs. The processing by 
which solutions are generated is based upon a recreation of the graph (working graph) 
representing the testing process (test graph). The recreation begins from an _ initial 
disconnected graph consisting of only nodes indicated as being important. This initial graph 
(importance graph) is the baseline graph and is evaluated for a cost value. The baseline is 
the cost to evaluate the behaviors, not including the tests to reach them. The working graph 
and the test graph are then compared for arc source and destination set commonalities. 
Consider each ordered pair of vertices v, w in the working graph. Add the edge v > w to 
the working graph if the edge v — w also appears in the test graph. After each addition of 
an arc, the graph cost is computed and graph information is generated. Additionally, once 
all arc set comparisons are completed, total graph cost information is generated for the node 
set. After computation of graph cost data for a node set, while the graphs are not equal, a 


node from the test graph not in the working graph is copied to the working graph. This is 
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done for every combination of arcs and nodes in the graph and continues until the working 
graph is equivalent to the test graph. This process generates every possible combination of 
arcs and nodes in the test graph and provides the scheduling cost data information for 
analysis information The following is a detailed description of the tool output. 
1. Output Description 

The output from the scheduling tool is placed on standard output for immediate 
evaluation. Each line has a field representing the number of nodes, the number of arcs, the 
total evaluation costs, the total initiation costs, the total test procedure costs and the total 
graph cost. The cost figures are as described in the node and arc information sections and 
are computed as follows: 

a. Evaluation Cost 

The evaluation cost is the cost of evaluating the individual observable 

behaviors of the graph. This includes the cost of required resources, instrumenting, 
collecting the results, all result comparisons, judging results, and the cost of evaluating the 
test oracle specified in the input data set. It is computed as the summation of all the 
evaluation cost variables of the nodes in the graph. 

b. Initiation Cost 

The initiation cost is the cost to evaluate an observable behavior without 

previously performing the pre-requisite test procedures; the initiation cost is the cost of 
observing a behavior in a state other than an identified start state having no pre-requisite 


requirements. It is computed as the summation of the initiation costs associated with all 


24 


nodes in the graph observed without performing the required pre-requisite observations. 
This would occur in a disconnected graph in which some node or nodes is an element of the 
graph but is not reachable via an arc traversal. The tool cost summation procedure identifies 
every node in the graph not designated as a destination node of any arc. The identified node 
initiation costs 1s the Initiation Cost of the graph. 

c. Test Procedure Cost 

The test procedure cost 1s computed by totalling the arc cost in the graph. The 

graph is traversed to identify those arcs having a source and destination arc in the graph. 
The identified arc costs are summed to determine the total procedure cost in the graph. 

d. Total Graph Cost 

The total graph cost is the summation of the evaluation costs, the initiation 
costs and the test procedure costs in the graph. This value represents the total cost to 
evaluate the observable behaviors in the graph. 
2. Output Processing 

The raw data generated from the scheduling tool is processed for evaluation using 
a Statistical analysis program. The program is designed to determine node and arc class 
data. For each combination of nodes and arcs, evaluation, initiation, procedure and total 
cost values are processed. The minimum, mean, maximum and standard deviation values 
for the initialization, test and total costs are calculated for each combination. This combined 
data is grouped by the number of nodes in the graph and sequenced by the number of arcs. 


The combined analysis data is the basis for the test scheduling evaluation. 
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E. DESIGN EVALUATION 

The graph representation allows for more flexibility in retaining the concepts of a test 
phase. This structure provides a simple traversal of the graph to evaluate necessary 
elements and calculate costs. This allows for specific data generation applicable to the 
study of software test scheduling. 

The graph design is implemented in Chapter II. In the implementation, the node and 
arc element values are described in detail to complete the representation of the input val- 
ues in the data structure. In addition to specifying the graph implementation details, the 
input set is operated upon using the scheduling tool and subsequently evaluated. The 
results of the evaluation of the scheduling data of the test set are concluded upon in Chap- 


ter IV. 
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Il. SCHEDULE-TOOL IMPLEMENTATION 


A. INTRODUCTION 

This study analyzed the patterns of graph costs of software testing plans. The primary 
goal of this research was to develop a process to generate all possible schedule solutions in 
a graphical representation of a testing process and determine what relationships exist; the 
goal of this study was to develop a strategy and a scheduling analysis tool in which the test 
scheduling solution can be identified for the purpose of reducing the complexity and burden 
of software system and product testing. 

This chapter describes how the data that was used was reduced to a form useful for 
analysis. The graphical representations (including node and edges descriptions) and input 


data set examples are presented. Finally, a schedule analysis solution is discussed. 


B. DESCRIPTION OF THE DATA 

The data taken for the examination were generated based on a specification of a 
program called Conflict that simulated combat interaction between two armies. The 
specification required the program to accept global data describing the position, size, and 
attributes of each army plus a description of the terrain operations were to be conducted on. 
The specification requires the program to return descriptions of the encounters between 


armies, plus a final condition of each army [SHIM 87]. 
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Each army is composed of one or more battalions, which are made up of one or more 
squadrons. The program is given global data concerning information on the initial location 
and attributes of each location. Encounters between the opposing armies are based on the 
description of their individual battalions as well as the environmental conditions of weather 
and terrain. Battalions are able to perform five distinct functions: attrition, restoration, 
movement, communication and observation [SHIM 87]. 

The test process modeled for this study was based on the testing requirements designed 
for the movement operation. The testing requirements required the introduction 
requirements, functional requirements and other individual aggregate variables for 
precondition purposes. The data generated for this application was based on a single 
application. The application test plans were prepared by undergraduate students in 
fulfillment of course work requirements and as testing research material and data [SHIM 


87]. 


C. ASSUMPTIONS AND PRECONDITIONS 

As with any research effort, there were certain assumptions made during the course of 
the development of the methodology of defining the input data. This study is based on a 
single application of a testing process. The application test plans were prepared by students 
in fulfillment of undergraduate course work requirements. Professional testers might have 
approached the test design process differently; a professional test team may have broken 


down the functionality differently and to a greater detail. The assumptions made in the 


28 


development of the data concern the application of cost parameters, both the direct and 
indirect applications through the assignment of values to initiation and evaluation cost 
elements. As will be discussed, these assumptions are important to the overall evaluation 
of this study. 
1. Assumption Related to Costs 
The cost used in this application is a function of the variables in the testing 
procedure. Cost is considered a measurement for evaluation only. There is no assumption 
of accuracy to some actual measure. Several factors in cost consideration are assumed to 
be distributed evenly to all operations as overhead: tester training, operator training, node 
identification, arc identification and test reporting. While these are not trivial costs, they are 
irrespective of order of test application. The costs used in the calculation of node and arc 
weights are the schedule dependent costs only. The schedule independent costs are 
included as overhead, and are assumed to be distributed over the entire test process. 
2. Assumption Related to Nodes 
It is assumed that each behavior is an identifiable subunit, so initiation and 
termination of behavior are both included in each node. Normal output (final location and 


final comparison) and error messages are always assumed to be viewed. 


D. GENERATION OF INPUT DATA 
In addition to the description of what is represented by each element, a description of 


the data, based on the test plan for the program Conflict is included. The information taken 
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from the application of the specification Conflict was obtained through the evaluation of 
secondary resources of the test plan. These unpublished resources included a Test Variant 
of the Battle Simulation Specification |SHIM 87], a Battle Simulation - Test Precis |SHIM 
87] and all applicable test procedures. 

The Test Variant of the Battle Simulation Specification breaks down the testable 
requirements delineated in the CONFLICT specification by highlighting the areas of 
interest to test. The Battle Simulation - Test Precis classifies the identifiers used in the Test 
Variant of the Battle Simulation Specification. There are five possible symbols used in the 
Battle Simulation - Test Precis: “A”, “T’,“T’, “NTR” and any combination thereof. An “A” 
is used to indicate that the identifier is a requirement needing careful analysis of the source 
code. An “I” indicates that the requirement can be verified from the source code. A “T” 
indicates that the requirement can be verified by a run-time test. The symbol “NTR” 
indicates a non-testable requirement. If two symbols were used, separated by a slash, then 
either class applied, depending on how the test planner decides its appropriateness to 
meeting the intended purpose of the identifier. The requirements were ordered in the same 
order as they appeared in the Test Variant of the Battle Simulation Specification. An excerpt 
of the MOVEMENT operation identifiers are illustrated in Figure 3.1. 

The descriptions of the data items include an explanation of its composition and the 
referencing resources. Each data item is made up of several inputs, requiring different 


computations based on the resource documentation it was generated from. The inputs are a 
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reflection of the descriptions of the scheduling tool, cross-referenced to the Model of 


Software Testing described in Chapter [, applied based on the specification. 


I. Determination of Node Weights (C ;) 


The weight of any node is the cost to evaluate the i observable behavior, 


including instrumenting and comparing results. Based on the specification, the movement 
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Run a scenario where movement of all 
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appropriate borders 


Figure 3.1 - Test Precis Excerpt 
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aggregates were identified and categorized (See Appendix D). The test evaluation 
requirements were reviewed to determine the number of comparisons necessary to evaluate 
the behavior based on the number of variables in the test procedure. The node cost was 
calculated by the multiplication of the sum of test cases, executions, revisions and 
modifications of the test scenarios by the number of variables in the test procedure. The 


total node cost is a summation of the evaluation and initiation costs. 


a. Evaluation Cost (C , 


The evaluation cost assigned to each node is the summation of the cost of 
collecting and judging results. The cost of collecting results is a function of the size 
(frequency) of the views of the variables. The cost for each node was determined based on 
the number of variable references made in the procedure requiring validation.The cost of 
judging results is a measure of the number of data to be compared at a specific time f¢, for 
each time ¢. The cost of judging results was calculated based on the number of variables 
requiring evaluation multiplied by the number of variable verification times for each test 
evaluation required by the test procedure. 

b. Initiation Cost (C i es 

The initiation cost assigned to each node is the measure of what it would cost 

to start from the node prior to completing the required pre-requisites at any time ¢. This 


includes the cost of instrumenting and the cost of executing enough to reach node x. The 


cost of instrumenting is determined based on the number of test data sets, the number of 
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views and the number of views needed to access needed pre-requisites. The cost of 
executing enough to reach node x is a function of the number of data sets and the total 
number of operator actions required by each pre-requisite. 

The representation of the data for input was made based on the costs calculated 
from these descriptions. The input data set included a line for each observable behavior in 
the test plan. The input line is ordered by the sequential assignment of behavior 
identification numbers, each having the specified importance factor, the initiation cost and 
finally, the evaluation cost. The behavior numbering was based on the pre-requisites and 
testing requirements determined in the behavior cost generation. See Figure 3.2 for an 


example of observable behavior input line. 


2. Determination of Edge Weights (C i A 


The weight of any arc is the cost to transition from the i observable behavior to 


the ia. observable behavior. The edge weight is the summation of the cost of adding 


instrumentation needed by i but not /, and the cost of executing enough to reach / from 1. 


suspicious 0 0.00 
suspicious 1 26.00 
suspicious 2 36.00 
important 3 4.00 


important 4 768.00 
suspicious 5 42.00 
important 6 30.00 





Figure 3.2 - Example Node Description Input 
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The cost of additional instrumentation needed by 7 but not j is the number of views needed 
to access ! (the number of views of i) not required by j. This was found by comparing the 
required variables of the previous observable behavior to the current behavior requirements 
and calculating the difference. This difference was the instrumentation needed by / but not 
j. The cost of executing enough to reach j from / is the summation of the number of new 
data sets in j not in 7, the number of modifications of old data sets and the additional 
operator actions required by j. This information was found in the test procedures as the 
number of data sets to be generated by the procedure for each case, the number of variables 
modifications for each case and the number of operator actions necessary for each test case 
in the test procedure. 
3. Determination of Test Process Graphical Structure 

The graphical structure of the testing process is based on the requirements of the 
test procedures. Each test procedure of the Movement Operation was reviewed to assess the 
necessary pre-requisites. The pre-requisite of any test procedure is a function of the 
behavior being observed, the modification procedures operating on the variables and the 
desired conditions of the observable behavior. In the Conflict Specification, behavior 
requirements are specified to include previous operations on variables, current procedures 
and descriptions of the behavior of the program. In addition to the Specification, the test 
procedures identified pre- and post-processing requirements. These were the inputs to the 
design of the graphical structure. Based on all the information, the test cases were 


represented in the input set as a logical string consisting of the source behavior 
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identification number, a test cost and the destination behavior identification number (See 
ieure 3.3). 

The application of these data generation specifications resulted in the creation of four 
input data sets (See Appendix E). The four data sets were created from the same input 
variables with modifications to the importance factors. In the first data set, the importance 
factor of every leaf node of the graph is set to important to simulate the requirement of 
observing the lowest levels of the requirements. The second data set placed importance on 
the pre-requisite nodes. Theses nodes are characterized as having one or more post 
conditional behaviors. In the third data set, the sub-tree root nodes are classified as the 
important behaviors for observation. Lastly, the fourth input data set classifies the sub-tree 
nodes as important for observation with a modification to the node set. In addition to the 
change of importance factors in the fourth data set, the set was modified to include an or 
conditional path. This path was added to enable us to review the and and or pre-requisite 


conditional paths. 


TESTO! O 9.00 1 
TEST 12” 155.0072 
TEST 214 2 5.00 14 
TEST 13 1 8.00 3 


TEST 16 1 7.00 6 
TEST 0S 033.00 9 
TEST 910 9 21.00 10 





Figure 3.3 - Example Test Input 
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The input sets provided the pre-requisite information necessary to generate the 
graphical representations (See Appendix F) and the sequencing of test information for 


processing. 


EK. TOOL DATA GENERATION AND INTERPRETATION 
I. Predictive Data Characteristics 

Based on the design of the data structure and the cost assignment criteria there are 
predictive characteristics of the output data. Specifically, there are four (4) types of cost 
calculations associated with the graph cost summation. Each of these are illustrated in 
Figure 3.4. A description of each case is as follows: 

(a) Behaviors A and B are unrelated. The cost calculation is: 

A+(B=A+€)=2A +6, for some cost €. 
(b) Behavior B is a functional follow-on to A. The cost calculation is: 
A+(A+Q)=2A + q, for some test cost a. 
(c) Behaviors A and B are both functional follow-on to C. The cost calculation 
is: C+A+B=C+(C+a)+(C+f) =3C+a+ B, for some test costs a and B. 
(d) Behavior C is a functional follow-on to either A or B. The cost calculation 
is: min((A + &),(B + B)), for some test costs a and B. 

An additional case used in test pre-requisite scheduling is the condition in which 

behavior C is a functional follow-on to A and B (not shown in Figure 3.4). The four 


illustrated cost calculations are consistent with the anticipated testing behaviors and the 
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data structure of the tool. The nature of the testing problem reveals that these are the only 
combinations used in scheduling. The combinations are due to the sequential nature of the 
testing process in which either an ordering of behaviors is followed or the pre-requisites of 
a behavior require the preprocessing of specific tests. In those cases where it is desired to 
observe a behavior prior to completing the necessary pre-requisites, the tests and costs of 
preparation are assumed by the behavior itself in the initiation cost variable. The graph 
structure allows for many possible path combinations, and as previously discussed allows 
for any node or observable behavior to be a starting state. Because of this, the initiation cost 
is designed such that a behavior requiring several levels of pre-requisite tests can build up 
to the necessary state of preparedness. 

The inherent building nature of testing allows for predictive patterns to develop. 
We can expect a binomial distribution of the output data due to the evaluation-initiation 
cost trade-off: When all completed precondition tests for some observable behavior are 
completed, there is no initiation cost. In cases where the preconditions have not been 


completed prior to observing a behavior, the initiation cost is applied as the estimated pre- 





Figure 3.4 - Functional Test Pre-requisite Relationships 
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requisite testing and evaluation costs. There are many possible variations we may see in the 
distribution of the data. The two most likely are narrow and broad distributions representing 
the effects of the behavior of the model evaluation-initiation cost trade-offs. A narrow 
distribution would represent a situation in which the difference between the test schedule 
of all the nodes and the test schedule of only the important nodes is small enough such that 
scheduling may be of no benefit to improving the testing process. If however, the difference 
in the graph costs is widely distributed (broad distribution) over the cost of performing the 
test schedule, the test scheduling solution may reduce the overall cost and improve the test 
coverage of the software testing phase or process. 
2. Data Evaluation 
Data generated based on the four input sets is presented in total in Appendix G. A 
review of the output data initially indicate the following characteristics: 
¢ All sets of node/arcs combination sets appear to have a similar shape or distribution. 
¢ The data has a binomial distribution (Narrow Distribution). 
¢ The mean cost in each data section appears to be close to the min/max midpoint in 
every cost combination. 


¢ The variation about the mean is consistently small relative to the overall total cost. 


For analysis purposes we will concentrate on one segment of data set four. Data 
set four was modified to include a unique test path to evaluate the effects of having an or 


conditional requirement. This was added to verify scheduling consistency and to enable us 
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to determine any unique or different schedule cost patterns. The output data set used for 
detailed evaluation is listed as the last section of data output four in Appendix I and is 
repeated in Table 3.1. 

The output data is consistent with the data evaluation characteristics discussed 
above. The data demonstrates that the variation in the total cost minimum and maximum is 
small as a percentage of the total cost. For example, the difference between the maximum 
and minimum costs for a graph having 20 nodes and 11 arcs (line 12 of Table 3.1) is 270. 


As a percentage, 270 units is 9.2% of the maximum total cost. While not insignificant, this 


Table 3.1 - Sample Output Data 


Initiation Cost Test Cost Total Cost 
i D 1 m m 


1 20/0 596.0 596.0 596.0 0.0 0.0 0.0 0.0 0.0 2945.0 2945.0 2945.0 0.0 
22 20/1 520.0 589.0 565.7 18.0 3.0 55.0 15.514.0 2911.0 2968.0 2930.2 15.0 
Zot) 20/ 2 456-0 584.0 535.7 25.0 6.0 99.0 31.0 19.3 2877.0 2968.0 2915.7 20.7 
1540 20/3 401.0 577.0 506.0 30.1 11.0 132.0 46.5 23.1 2843.0 2968.0 2901.5 24.7 
7315 20/4 359.0 568.0 476.6 34.1 16.0 165.0 62.0 26.0 2811.0 2968.0 2887.6 27.7 
26334 20/5 318.0 560.0 447.5 37.3 23.0 195.0 77.5 28.2 2779.0 2967.0 2874.0 30.1 
74613 20/6 277.0 551.0 418.7 40.0 30.0 216.0 93.0 30.0 2750.0 2967.0 2860.7 32.0 
170544 20/7 240.0 538.0 390.2 42.2 37.0 230.0 108.5 31.3 2723.0 2964.0 2847.7 33.5 
319770 20/8 207.0 522.0 362.1 44.0 45.0 243.0 124.0 32.4 2704.0 2961.0 2835.1 34.7 
497420 20/9 175.0 505.0 334.2 45.4 53.0 255.0 139.5 33.1 2692.0 2958.0 2822.7 35.6 
646646 20/10 143.0 480.0 306.6 46.4 61.0 264.0 155.0 33.5 2683.0 2952.0 2810.6 36.2 
705432 20/11 117.0 463.0 279.4 47.0 69.0 272.0 170.5 33.6 2674.0 2944.0 2798.9 36.5 
646646 20/12 91.0 437.0 252.5 47.3 77.0 280.0 186.0 33.5 2665.0 2935.0 2787.5 36.5 
497420 20/13 74.0 411.0 225.8 47.2 86.0 288.0 201.5 33.1 2657.0 2923.0 2776.3 36.2 
319770 20/14 57.0 379.0 200.0 46.6 98.0 296.0 217.0 32.4 2651.0 2909.0 2765.5 35.7 
170544 20/15 41.0 347.0 173.5 45.6 304.0 232.5 31.3 2648.0 2897.0 2755.0 34.28 
74613 20/16 28.0 314.0 147.8 44.1 .O 311.0 248.0 30.0 2648.0 2878.0 2744.8 33.5 
26334 20/17 16.0 277.0 122.4 41.9 0 318.0 263.5 28.2 2648.0 2851.0 2734.9 31.8 
7315 20/18 7.0236.0 97.3 39.0 0 325.0 279.0 26.0 2648.0 2822.0 2725.3 29.5 
1540 20/19 0.0195.0 72.5 35.1 0 330.0 294.5 23.1 2651.0 2790.0 2716.0 
231 20/20 0.0140.0 48.0 29.7 .0 335.0 310.0 19.3 2659.0 2758.0 2707.0 
22 20/21 10.0 76.0 23.9 21.8 0 338.0 325.5 14.0 2667.0 2724.0 2698.4 
1202 0.00 0.0 0.0 0.0 0 341.0 341.0 0.0 2690.0 2690.0 2690.0 





a. 


leads us to believe that as a percentage of the total cost, the difference in any test schedule 
solution is insufficient for an extensive search for the optimal schedule; with a small 
variation from the smallest to the largest cost, it leads us to believe that the expense and 
resources needed to develop the test schedule would exceed any realized scheduled 
improvements and savings. 

In addition to the total cost variation, the data implies that any of the test schedule 
combinations is suitable under a small deviation from the mean; a test schedule cost for 
each combination of nodes and arcs, tests and observable behaviors is generally within a 
small range from the mean of the total cost of the graph having all behaviors and tests 
included. The total cost information on line 12 of Table 3.1 shows that the mean of the 
graphs (2798.9) is 10 percentage points below the average cost of 2809 [(max+min)/2]). 
Hence, the distribution of the graph costs is narrow with a majority of all graphs within 
close distance from the mean. 

3. Implication of Data 

As discussed in the previous section, the data indicate that there is little variation 
in the costs of any combination of test schedules. Based on the nature of the testing process, 
we could expect the trade-offs’ in the initiation/evaluation. The testing process drives the 
binomial behavior due to the cost considerations and pre-requisite conditions of each 
observable behavior. In every instance, either the pre-requisites have been completed, thus 
assuming the cost consideration in the previous evaluations and test, or the observing 


behavior must perform the pre-requisite tests and observations and assume the cost of set- 


40 


up in the initiation cost variable. Because of this, the difference in cost between the most 
optimal schedule and the unscheduled process does not appear large enough to warrant test 
scheduling. The necessary details required to develop a test schedule solution do not 


provide an adequate return to a software tester. 


F. CONCLUSION 

This chapter has presented the implementation details and results of this study. It has 
also suggested that the results of this study demonstrate that the difference between an 
optimal testing solution and a loosely based sequence of tests is small enough relative to 
the total scheduling cost not to warrant test scheduling. The last chapter summarizes the 
findings of this thesis and discusses how these findings support or contrast performing a 
scheduling analysis process to the software test plan. In addition to a review of current 
findings, a discussion of possible follow-on study and directions for further research is 


presented. 


4) 


IV. CONCLUSIONS AND RECOMMENDATIONS FOR FUTURE 
RESEARCH 


The purpose of this thesis is to develop and evaluate a test schedule solution. In 
addition to increasing the efficiency of testing, it was proposed that the process of 
scheduling the test set could provide several advantages during software development. In 
the course of analyzing the solutions, it was determined that the time and expense involved 
in developing the input set outweigh any savings in improved scheduling of the test 
procedures. While the results of this work do not appear promising, the experimental 
population was small, narrowly focused and based on a single testing implementation. 

A. CONCLUSIONS 

This thesis has been the first examination of a software test scheduling solution. The 
observations and findings presented in the previous chapters provide a basic knowledge 
about the process and a limited evaluation of its results. As discussed in Chapter III, there 
are limitations to the implementation usefulness of the solution. Despite these limitations, 
this study has provided a basis from which some general conclusions may be made and 
several areas for future research. 

As expected, the output data was binomially distributed. This is apparent based on 
examination of the Standard Deviation about the mean for every output node set. The 


binomial distribution results from the model evaluation-initiation cost trade-offs. This 
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distribution of the cost data by the number of arcs is narrow for each node set in each input 
data set. As was previously discussed. a narrow distribution of cost data represent a 
situation in which the difference between the test schedule of all the nodes and the test 
schedule ot only the important nodes is small enough such that scheduling may be of no 
benefit to improving the testing process. In every node set the minimum cost to evaluate 
the important behaviors is within a small percentage (<15%) of the maximum cost. 
Additionally, despite the fact that the total cost of performing all the test procedures is less 
than the total cost to perform no test procedures, the difference is small enough to 
generalize that any combination of arc may be optimal. Based on the distribution, and the 
data comparisons made in Chapter III, an analysis of the functionality of the model and the 
performance data, a test schedule is not beneficial to the testing process. 

While this research has identified difficulties in implementing the testing process 
graphically, further development of this process may enhance an understanding of the test 
scheduling process in the software testing environment. The solutions generated based on 
the input set used in this study do not indicate that scheduling will improve coverage 
through increased efficiency and a reduction in costs. However, even if this solution 
provided a noticeable optimal schedule cost it would not be sufficient to imply without 
limitations that scheduling improves the testing process. This study demonstrates that 
testing is a very complex process requiring significant resources and efforts of the software 


development process. 
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B. RECOMMENDATIONS FOR FUTURE RESEARCH 

The results of this study indicate that there are several areas of research suitable for 
further research. The goai of this thesis has been to develop information useful in the 
software development process. To this end, a final analysis of test scheduling cannot be 
made prior to evaiuating variations in the testing pre-requisites, assignment of initiation 
requirements and the cost categories. 

The nature of testing has limitations on the assignment of preconditions to a test or an 
observable behavior. While this cannot be changed, an evaluation of pre- and post- 
conditions can be made to determine if a sequential ordering is necessary. There are 
instances in the testing process in which pre-requisites must be completed. If required 
behaviors and tests are performed as a logical group in stages, this may reduce the set of 
tests and behaviors requiring sequencing. This is implied by the model, but in practice it 
may be very difficult to implement. 

The variations of evaluation variables may impact the scheduling solutions. A single 
unit cost was assigned to the variables for each operation. No variation in unit assignment 
was made based on the complexity of the variable or process. This implies that there exists 
a one to one correspondence in the cost of performing the tests, observing the behavior, 
analyzing the results and comparing the results. In actuality this is most likely not correct. 
A study of differing cost unit assignments may demonstrate a closer relationship between 


the unit assignments and a scheduling solution. 


Consideration must be made regarding the selection of cost data generation. Due to the 
development process. there are many possibilities in developing the cost basis for data 
design in test scheduling. An examination of the different development processes and the 
effects on the data generation may be of interest. Specifically, an analysis of the prototyping 
and spiral development models could provide insight to improving the test and testing 
design process. 

Software test scheduling does not appear to improve or benefit the testing process. 
There are several areas in which different applications in the schedule deveiopment that 
may improve the scheduling design and thus increase the benefit to the testing process. 
Until these new applications are developed, applied and studied, no economical procedure 
is available. Improvements in detailing requirements, assigning cost functionality and 
managing pre-requisites may have a practicable effect on a schedule of software tests. Until 
these improvements are made, test scheduling is not a viable solution to reducing costs and 


improving test verification, validation and coverage. 
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APPENDIX A: Parser 


driver.a 


with u_env.parser.input_lex_io.input_lex.text_io.Graph_Works: 
use U_env.parser.text_1o; 


procedure parse 1s 
in_file_name : string(1..80); 
last : natural; 
response —_: character: 
completed =: boolean := false: 


begin 
text_io.put(""Enter input file: "); 
text_io.get_line(in_file_name, last); 
input_lex_io.open_input(in_file_name(1..last)); 
input_lex_io.create_output; 


yyparse: 


input_lex_io.close_input: 
input_lex_io.close_output; 


Graph_Works.Create_Graph_Of_Important_Nodes; 


Graph_Works.Generate_All_Graphs_And_Costs; 


end parse; 
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-- Declaration Section 
%token NODE_TOKEN TEST_TOKEN LIMIT_TOKEN 
Y%token ID_TOKEN SUSPICIOUS_TOKEN IMPORTANT_TOKEN 
Z%token COLOR_TOKEN COST_TOKEN 
Ztoken TOK_OPEN TOK_CLOSE 
Yostart input 
-- Declarations that will be written to the token package. 
{ 

subtype key 1s integer: 

subtype yystype Is integer: 

last_id MNTEGER = 0: 

arc_COst, 

eval_cost, 

init_cost. 

last_cost, 

immit cost : FLOAT :=0.0; 

conversion =: constant FLOAT := 0.01; 

from_vertex, 

to_vertex, 

Gibent_test : key; 

first_vertex : boolean := true; 


} 


%%J% -- Rules Section 


input: nodesect testsect limitsect: 


node : IMPORTANT_TOKEN ID_TOKEN COST_TOKEN {eval_cost := last_cost; } 
COST_TOKEN {init_cost := last_cost; 
build_item(last_id,eval_cost,init_cost,graph_works.important); } | 
SUSPICIOUS_TOKEN ID_TOKEN COST_TOKEN {eval_cost := last_cost:} 
COST_TOKEN {init_cost := last_cost; 
build_item(last_id,eval_cost,init_cost,graph_works.suspicious); }; 


nodesect : node nodesect | node; 


test : TEST_TOKEN ID_TOKEN 
{set_test_id(last_id,current_test); } idpair; 
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testsect : test testsect | test: 


idpair : ID_TOKEN COST_TOKEN 
{if not first vertex then 
Ol Vertex <= lichald. 
add_arc(from_vertex.arc_cost.to_vertex ); 
from Verte: —=40_ vertex: 
are Cost -= last zcost: 
else 
frOnlavertex .— ldstaia. 
are scOSt <= lasfacost: 
lastid?- =U lastzcost.— 0 0: 
fitst Vettexs — indice: 
end if; } 
idpair | ID_TOKEN 
{ton vertex .—lasteid: 
add_arc(iroim__ vertex ares COStton vertex): 
lastzida=Oclastwcest.— U0: 
first_vertex := true; }; 


limitsect : LIMIT_TOKEN COST_TOKEN 
(limi scost.—tastacost.). 


%%_ -- User Declarations 


with input_tokens.graph_works; 
use input_tokens; 


package parser is 
procedure yyparse; 
procedure set_test_id(last_id : in graph_works. KEY; 


test_id : out graph_works.KEY); 


procedure build_item(last_id : in INTEGER; 
eval_cost : in FLOAT; 
init_cost : in FLOAT; 
node_color : in graph_works. IMPORTANCE); 


procedure add_arc(vertex_1 >In out graph_works.key; 
attribute_cost : in out float; 
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VeEnleX ay : in out graph_works.kev): 

end parser: 
with input_tokens.input_goto.input_shift_reduce.input_lex.text_io.graph_works: 
use input_tokens.input_goto.input_shift_reduce.input_lex.text_io: 
package body parser is 

package key_io is new text_io.integer_io(graph_works. key); 

package natural_io is new text_io.integer_1o(natural); 

package float_inout 1s new float_io( float); 

package importance_io is new enumeration_io( graph_works.importance): 


num_errors : INTEGER :=0; 


procedure set_test_id(last_id: in graph_works. KEY; 
test_id : out graph_works. KEY) is 


begin 
test_id := last_id; 


end set_test_id: 


procedure yyerror(s: in string := "syntax error’) 1s 
begin 
num_errors := num_errors + 1; 
end yyerror; 
procedure build_item(last_id : in INTEGER; 
eval_cost : in FLOAT; 
init_cost : in FLOAT; 
node_color : in graph_works. IMPORTANCE) is 


temp_item : graph_works.item; 


begin 
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temp_item.id = ERO 
temp_item.eval_cost := eval_cost: 

temp _item Init (cost = initscost. 
temp_item.color := node_color: 
temp_item.covered  := false: 
graph_works.Add_A_Node(TEMP_ITEM): 


end build_item: 


procedure add_arc(vertex_| > In out graph_works.key; 
attribute_cost : in out float; 
Velloxere : in out graph_works.key) is 


arc_name : graph_works.name; 


function COMPUTE_ARC_ID(vertex_id_1, vertex_id_2 : in graph_works.KEY) 
return graph_works.KEY is 


arc_key : graph_works.key := 0; 


begin 
arc_key := vertex id= t ~ 10) vertexarda 
return arc_key; 

end COMPUTE_ARC_ID; 


begin 
arc_name.id := compute_arc_id(vertex_1, vertex_2); 
arc_name.of_test := current_test: 
are namMe.cost -= atthibute cost: 
arc_name.transitioned := false; 
graph_works.Add_An_Arc(ARC_NAME, vertex_1, vertex_2); 
end add_arc; 


##% procedure_parse 


end parser; 
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%oSTART IDENT Z 
A [aA] 
B [bB] 

c (c€] 

D [dD] 

E [eE] 

F [fF] 

G [gG] 

H [hH] 

I [it] 

J LJ] 

IK [kK] 

L [IL] 

[mM] 

[nN] 

[oO] 

[pP] 

[qQ] 

[rR] 

[sS] 

[tT] 

[uU] 

[vV] 

[wW] 

[xX] 

LyY] 

[zZ] 

NODE [nN][oO][dD][eE] 

TEST [tT][eE][sS][tT] 

LIMIT (IL) [iT] [mM] [il] [tT] 

IMPORTANT [il][mM)][pP][oO][rR][tT] [aA ][nN][tT] 
SUSPICIOUS [sS][uU][sS][pP]{il][cC][iN[oO][uU][sS] 
Too 

{NODE} {ENTER(Z); retun(NODE_TOKEN);} 
{TEST} {ENTER(Z); return(TEST_TOKEN); } 
{LIMIT} {ENTER(Z); return(LIMIT_TOKEN); } 
{ 
{ 


Ns So eS Wee O24 = 


IMPORTANT} {ENTER(Z); return(IMPORTANT_TOKEN)); } 
SUSPICIOUS} {ENTER(Z); return(SUSPICIOUS_TOKEN),; } 
[0-9]+ {declare 
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1: integer; 
mytext: string(1..100) := (others=>ASCII.NUL); 
begin 
copy(yytext,mytext): 
lastid== 0); 
=— 
while ( mytext(1) /= ASCII.NUL ) loop 
last_id := last_id * 10 + character'pos(mytext(1)) - character'pos('0’): 
v=o 
end loop; 
ifi> 1 then -- we lexed something 
return(ID_TOKEN): 
else 
put_line("Cannot find id matched by lex"); 
new_line: 
last_id := 0; 
return(ID_TOKEN); 
end if; 
exception 
when others=> 
put_line("Error in lexing ID"); 
new_line; 
lastaid= =): 
return(ID_TOKEN); 
end; -- declare 


} 


[0-9]+[.][0-9][0-9] {declare 
1, 
int_part, 
dec_part :integer; 
mytext:string(1..100) := (others=>ASCII.NUL); 
begin 
copy(yytext,mytext); 
t=; 
int_part := 0; 
dec_part := 0; 
while mytext(i)/= '.' and mytext(i)/=ASCIH.NUL loop 
int_part := int_part * 10 + character'pos(mytext(i)) - 
character'pos('0'); 
11s 
end loop; 
i:=i+1; -- skip the '.' (decimal) 
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while mytext(1)/=ASCH.NUL loop 
dec_part := dec_part * 10 + character'pos(mytext(1)) - 
character pos(‘0’); 
i:=i+ 1; 
end loop: 
ifi>1 then -- we lexed something 
last_cost := float(int_part) + (float(dec_part)*conversion); 
return(COST_TOKEN); 
else 
lastacest:— (0. 
end if; 
exception 
when others=> 
new_line; 
put_line("Exception in COST loops"); 
raise: 
end: } 


To Vo 


with input_tokens, text_io; 
use input_tokens, text_io; 


package input_lex is 
function yylex return token: 
end input_lex; 
package body input_lex is 
procedure copy(s1: in string; s2:in out string) 1s 
j:integer range s2'range := s2'first; 
begin 
for iin sl'range loop 
s2(j) :=s1(i); 
jis=j+ls 
end loop; 
end copy; 
it 


end input_lex; 
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APPENDIX B: Scheduling Tool Program 


with Text_lO.Graph_Package,link_list. SEQUENTIAL_IO: 
use Vext sie: 


package GRAPH_WORKS is 


type IMPORTANCE is (IMPORTANT, SUSPICIOUS); 
subtype KEY is INTEGER; 


type ITEM is 
record 
ID KEG 
EVALZCOST sFEOAT. 
INIT_COST- ELOAL 
COLOR : IMPORTANCE; -- COLOR is a holdover from a red/blue designation 
COVERED : BOOLEAN: 
end record; 


type NAME is 
record 
ID “KEY. 
OF TEST) 2khEx 
COST : FLOAT; 
TRANSITIONED : BOOLEAN; 
end record; 


package TEST_GRAPH is new GRAPH_PACKAGE(ITEM.NAME),; 
use TEST_GRAPH:;: 


package ARC_LIST is new LINK_LIST(TEST_GRAPH.ARC); 
use ARC_LIST; 


FINISH_GRAPH, 
IMPORTANT_GRAPH, 
FULESGRAPE 

THE_GRAPH : GRAPH; 
TEMP_VERTEX_1, 
TEMP_VERTEX_2, 
WORKING_VERTEX  : VERTEX; 
TEMP_ARC : ARC; 
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TEMP_ID PINE: 
GRAPH_COUNT SNATORAL == 1; 
BHESARC LIST =: LINK: 


procedure Add_A_Node(TEMP_ITEM : in out ITEM); 


procedure Add_An_Arc(ARC_NAME._: in out NAME; 
VERTEX _[D_1* in out KEY, 
VERTEX_ID_2: in out KEY): 


procedure Print_Current_Vertices( Working_graph : in out GRAPH); 
procedure Clear_Covered_Variable(Working_ graph : in out GRAPH); 
procedure Calculate_Graph_Cost(A_Graph — : in out GRAPH); 


procedure Vertex_Compare(CHECKING_GRAPH : in out GRAPH: 
V_ID >in KEY; 
MATCHING_VERTEX: out VERTEX; 
MATCH_FOUND _ : out BOOLEAN); 


procedure Arc_Compare(CHECKING_GRAPH : in out GRAPH; 
VERTEX_1, 
VERTEX_2 : in out VERTEX; 
REF_ATTRIBUTE  : in NAME; 
REF_ARC : out ARC; 
ARC_MATCH_FOUND : out BOOLEAN); 


procedure Create_Graph_Of_Important_Nodes; 


procedure Create_Disconnected_Graph(REFERENCE_GRAPH = :in out GRAPH; 
DISCONNECTED_GRAPH : in out GRAPH); 


procedure Find_Arc_Points(AN_ARC :in out ARC; 
A_GRAPH : in out GRAPH; 
ARC_ATTRIBUTE : in out NAME; 
VERTEX_SOURCE, 
VERTEX_DEST  : in out VERTEX; 
POINTS_FOUND : out BOOLEAN); 


procedure Build_Arc_Link_ListWORKING_GRAPH, 


FULL_GRAPH — : in out GRAPH; 
ARC_LINK_LIST : in out LINK); 
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procedure Generate_All_Graphs_And_Costs: 


end GRAPH_WORKS:;: 
package body GRAPH_WORKS is 


package key_io is new text_io.integer_io(key); 

package natural_io is new text_io.integer_io(natural); 
package float_inout is new float_io(float); 

package importance_io is new enumeration_1o(importance); 


2 ROK 2 2 2 ee 2 2K 2 2c 2 og gg gg 2 i 2 ok 2 oi 2 ig i gg 2 2 ic 2 eG 2 2 2 2 2 gC IC 2S SC OE 2g OIC OS OC 2g 2 2G OC OO OK 2 2k 2c oo 2 ok 


--This procedure Adds a node to the Graph using the GRAPH PACKAGE procedure 
--Add. 
aK KK OK OK 2K ok 2 kk 2k 2k 2k 2 2K oie 2 2g 2 oo gg 2 2 2 2 2g 2 fe 2 2 oi ok 2k 2k 2k 2k 2 2g SS OIC OIC OC OO OE SS 2 2 2 2 OE oI SO 2k 2 2 2K ok oe ok 
procedure Add_A_Node(TEMP_ITEM : in out ITEM) is 
begin 
Add(TEMP_VERTEX_1, TEMP_ITEM, THE_GRAPH); 
end Add_A_Node: 


ww OK AR AE OK OK OE 2 OE 2 OE OI OR OE KO G2 2 OC 2 2G 2 RO OC OC CO CO IG OIE KC 2 SO C2 OEE 2G 2 C2 2S IC 2G I eC IE OC ES 2 OE 2 2g 2k 2 OCC OC 2K OK 2K 


--This procedure Adds an Arc to the Graph with the source and destination nodes 
--This procedure uses the GRAPH PACKAGE vertex traversal to locate the vertices 
-- of the Arc to be added. 
3K KK OK OK OK OK KK OK OK OK 2 KK OK OK og OK OK 2g RR OR KOK 2 oie og 2 KO 2 2G RR 2K OO OK ik 2G 2g 2K OK oi 2k 2 2K 2 2K 2K 2g 2K 2K OK OK OK 
procedure Add_An_Arc(ARC_NAME._ : in out NAME; 
VERTEX ID=] sinoul hay 
VERTEX_ID 2: in out KEY) 1s 


procedure VERTEX_SEARCH (THE_VERTEX  : in TEST_GRAPH.VERTEX; 
CONTINUE — : out BOOLEAN) is 
TEMP_ITEM : ITEM; 
begin 
TEMP_ITEM := Item_Of(THE_VERTEX); 
if TEMP_ITEM.ID = TEMP_ID then 
WORKING_VERTEX := THE_VERTEX; 
end if; 
CONTINUE := TRUE; 
end VERTEX_SEARCH; 
procedure GET_VERTEX is new 
TEST_GRAPH.Iterate_Vertices(VERTEX_SEARCH); 
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begin -- begin for Add_An_Arc 


etiP iD:= VERTEX_ID_1; GET_VERTEX(THE_GRAPH): 

TEMP_VERTEX_1! := WORKING_VERTEX: 

TEMP_ID:= VERTEX_ID_2; GET_VERTEX(THE_GRAPH); 

TEMP_VERTEX_2 := WORKING_VERTEX; 

TEST_GRAPH.CREATE(TEMP_ARC,ARC_NAME,TEMP_VERTEX_1, 
TEMP_VERTEX_2,THE_GRAPH): 


end Add_An_ Arc: 


ww KE 2K 2 2 2 2 2 2k 2h 2 2 OK 2k 2 2g 2 2 2 2 2 2 2c 2k 2 2 oie 2k oie 2c oie ok og 2k 2 2 2 2c og ie 2 fe 2 2 OK 2c 2 2 2c oe 2c 2 2 kok 2k 2k 2k 2K ok Ok 


--This procedure generates a Graph of nodes indicating a positive importance factor. 
--The procedure uses the GRAPH PACKAGE vertex traversal procedure to evaluate 
--each node in the input graph. 

oo KE KK OK ROK 2k OK 2 OK 2 2 2 2 2K 2 2 OK 2 ok oie 2g oie 2 2 oie 2 2 ke 2 oie 2 2 oe ok ie ie ie 2 2 2 2c 2k 2 ok 2 OK OK 2K OK 2k OK OK 2K OK OK ok OK ok ok ok OK Kk ok OK OK 


procedure Create_Graph_Of_Important_Nodes is 
temp_graph : TEST_GRAPH.GRAPH; 


procedure IMPORTANT_LOOK(THE_VERTEX  : in TEST_GRAPH. VERTEX; 
CONTINUE _— : out BOOLEAN) is 
temp_item : ITEM; 
begin 
temp_item := TEST_GRAPH.Item_Of(the_vertex); 
if temp_item.color = important then 
TEST_GRAPH.Add(TEMP_VERTEX_1, temp_item, temp_graph); 
end if; 
CONTINUE := TRUE; 
end IMPORTANT_LOOK; 
procedure generate_important_graph is new 
TEST_GRAPH .Iterate_VerticessIMPORTANT_LOOK),; 


begin ~-- create_graph_of_important_nodes 
TEST_GRAPH.Clear(FINISH_GRAPH); 
TEST_GRAPH.Copy(THE_GRAPH, FULL_GRAPH); 
generate_important_graph(FULL_GRAPH); 
TEST_GRAPH.Copy(TEMP_GRAPH, IMPORTANT_GRAPH); 


end Create_Graph_Of_Important_Nodes; 
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--This procedrue is designed to compare two vertices of different graphs to determine 
--if they are identical. The procedure uses the GRAPH PACKAGE traversal procedure 
--to compare each node of the graphs until a match is found. 
OK RK OK OK og OK 2K ok 2 2K 2K oi oi 2k ok 2k 2K OK 2K 2K 2g ok 2k ok OK OK OK OK OK OK 2K OK OK OK OK OK 2K oi 2K 2g 2 oi OK 2K 2 2 2K 2g OK 2K 2K 2k 2k og oi 2 ok 2K 2K ok 2k OK 2k 2k 2 2K ok 
procedure VERTEX_COMPARE( 
CHECKING_GRAPH: in out TEST_GRAPH.GRAPH; 
V_ID “in KEY: 
MATCHING_VERTEX: out TEST_GRAPH. VERTEX; 
MATCH_FOUND _ : out BOOLEAN) is 


procedure ID_SEARCH(THE_VERTEX : in TEST_GRAPH.VERTEX: 
CONTINUE — : out BOOLEAN) is 
TEMP_ITEM : ITEM; 
begin 
TEMP_ITEM := TEST_GRAPH.Item_Of(THE_VERTEX); 
if V_ID = TEMP_ITEM._ID then 
MATCH_FOUND := TRUE; 
MATCHING_VERTEX := THE_VERTEX; 
CONTINUE := FALSE; 
else 
MATCH_FOUND := FALSE; 
CONTINUE := TRUE; 
end if; 


end ID_SEARCH: 
procedure VERTEX_MATCH is new TEST_GRAPH.Iterate_Vertices(ID_SEARCH); 


begin 
if TEST_GRAPH.Number_Of_Vertices_In(CHECKING_GRAPH) = 0 then 
MATCH_FOUND := FALSE; 
else 
VERTEX_MATCH(CHECKING_GRAPH); 
end if; 
end VERTEX_COMPARE; 
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--This procedure performs an arc comparison between two arcs of different graphs. 
--This procedure uses the GRAPH PACKAGE arc traversal procedure. 


wR OK 2K OK OK OK KK OK 2K OK OK ie fe 2 6 2 OK 6 2 2K OK ok OK 2 2 OK ok ok OK 28 2K 2K 2 2K OK 2K OK OK OK ik 2 ie 2k 2g 2g 2g OO OO i OO OK oi OK OK OK Ok KK 


procedure ARC_COMPARE(CHECKING_GRAPH : in out TEST_GRAPH.GRAPH: 


VERIEX 

VERTEX_2 ain Our tes ISGRAPH.Y ERTEX; 
REF_ATTRIBUTE >in NAME: 

REF_ARC Pout VESTOGRAPEARE: 


ARC_MATCH_FOUND : out BOOLEAN) is 


procedure ARC ID SEARCH(THE_ARC :in TEST_GRAPH.ARC; 
CONTINUE : out BOOLEAN) is 


TEMP_ATTRIBUTE : NAME; 


begin 
TEMP_ATTRIBUTE := TEST_GRAPH.Attribute_Of(THE_ARC); 
if REF_ATTRIBUTE.ID = TEMP_ATTRIBUTE.ID then 
if REF_ATTRIBUTE.OF_TEST = TEMP_ATTRIBUTE.OF_TEST then 
ARC_MATCH_FOUND := TRUE; 
REF_ARC := THE_ARC; 
CONTINUE := FALSE; 
cise 
ARC_MATCH_FOUND := FALSE; 
CONTINUE := TRUE: 
end if; 
else 
ARC_MATCH_FOUND := FALSE; 
CONTINUE := TRUE; 
end if; 
end ARC_ID_SEARCH; 
procedure ARC_MATCH is new 
TEST_GRAPH.Iterate_Arcs(ARC_ID_SEARCH); 


begin 
if TEST_GRAPH.Number_Of_Arcs_In(CHECKING_GRAPH) = 0 then 
ARC_MATCH_FOUND := FALSE; 


else 
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ARC_MATCH(CHECKING_GRAPH): 
end if: 
end ARC_COMPARE: 


7K 2K OK 2k 2k 2k ok 2k 2K 2k ok 2K 2K 2k 2k 2K 2K 2K 2K 2K 6 ok 2k OK 2k 2k 2K 2k 2K 2K OK 2k 2k 2 ok OK 2K 2K 2k 2K 2K 2K OK 2K 2K 2K 2k 2K 2k 2K 2k 2K 2K 2 ok OK 2k OK 2K 2k 2K 2k 2K 2K Ok OK 2K Ok 


--This procedure outputs the Vertex data of all vertices in the specified graph 
_ OK 2 2K 2k 2k 2k ok ok ok 2k 2K 2K 2K 2K 2k 2K 2k 2K OK 2K 2K 2K 2K OK 2k 2 2k 2k 2k 2k 2k 2K 2k 2K 2K 2K 2K 2K 2K 2K 2 2K 2K OK 2K 2K 2k 2K 2K OK 2k 2K OK OK OK 2k 2 2K 2 kK ok 2 KK KK KK 


procedure Print_Current_Vertices( Working_graph : in out GRAPH) is 


procedure print_all_vertices(The_Vertex : in TEST_GRAPH. VERTEX: 
Continue : out BOOLEAN) is 

temp_item : ITEM: 

begin 
temp_item := TEST_GRAPH.Item_Of(The_ Vertex); 
KEY_IO.PUT(temp_item.ID. width => 2); 
TEXT 10 PUT): 
Continue — line: 

end print_all_vertices: 


procedure output_vertex_ids is new 
TEST_GRAPH .Iterate_Vertices(print_all_vertices); 


begin --Print_Current_Vertices 


output_vertex_ids(Working_Graph); 
end Print_Current_Vertices; 


_ 8 2K 2k 2k 2K ok 2k 2K 2k 2k 2K 2k 2k ok 2k 2K 2K 2 2K 2 2K 2k 2k 2K 2 2 2K ok 2 2K 6 2k 26 og 26 2g 2 og 26 2K ok 2k 2 2k 2 2 2 2k 2k 2k ok 2k 2 2 2 2K 2 2K 2 ok 2k og 2K 2 ok 2k 2k OK 


--This procedure resets the coverage variable in the vertices of the graph. 
_ KK BK ok 2k ok ok 2k 2k ok 2K 2k BK OK 2K 2k 2k 2k OK 2K 2K 2k OK 2K 2K ok ok 2K 2k 2k 2 2 2k oe fe i 2k of 2 2 ok 2k 2k 2 2 2K 2k ok 2K 26 os 2K 2k 2 6 oi oe 6 2k 2s 3 2k 2k 2k 2k ok ok 


procedure Clear_Covered_Variable(Working_graph : in out TEST_GRAPH.GRAPAH) is 


procedure Travel_Vertices(The_ Vertex : in TEST_GRAPH. VERTEX; 
Continue : out BOOLEAN) is 
New_lItem, 
Temp_Item : ITEM; 
Temp_ Vertex : TEST_GRAPH. VERTEX; 


begin 
Temp_ Vertex := The_ Vertex; 
Temp_Item := TEST_GRAPH.Item_Of(The_ Vertex); 
New_Item.ID := Temp_Item.ID; 
New_Item.EVAL_COST := Temp_Item.EVAL_COST; 
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Rew sitemelNIMeCOST -= Temp _ltem. INIT COST: 
New_Item.COLOR  := Temp_Item.COLOR: 
New_Item.COVERED := False: 
TEST_GRAPH.SET_ITEM(Temp_Vertex.New_lItem): 
Sontinue = Irie: 

end travel_vertices: 

procedure Clear_Covered is new 

TEST_GRAPH.Iterate_Vertices( Travel_ Vertices): 


begin 
Clear_Covered(Working_Graph); 


end Clear_Covered_ Variable: 


wa EK OK OK OK OK OK OK OK OK OK OK OK OK OK OK OK OK OK OK OK 2K OK OK 2 2K OK 2K OK 3K 2c 2K 2K 2K OK 2k ok 2k 2K 2K 2K 2K 2K 2K 2K 2k 2K 2K 2K 2K 2K 2K 2K 2K 2K 2K 2K 2K 2K 2K 2K 2k 2 2K OK KOK OK 


--This procedure calculates the graph costs tor data generation. 
0K AK 2K 2 2 KK 2 KK 2K 2K 0K OK 2K OK 2K OK 2K 2K 2 2 2K 2K 2K 2K OK 2k ok ok 2k 2K 2k 2K 2k 2K 2K 2K 2K 2K 2K 2K OK 2k 2K KK OK 2K 0K OK OK 2K 2K OK OK OK OK OK OK OK OK OK KOK KKK 


procedure Calculate_Graph_Cost(A_Graph —: in out TEST_GRAPH.GRAPH) is 


arc_count. 

vertex_number : NATURAL; 
vertex_eval_cost, 

vertex_init_cost, 

WeETLeX_COSt, 

arc_cost, 

graph_cost : FLOAT := 0.0; 
display_the_arcs, 

display_the_vertices : BOOLEAN := FALSE; 


0K KK 2K OK OK 2K OK 2 oe ie 2K 2K 2K ie 2K OK OK OK 2K 2 2 2k 2 2k 0K 2K KK 2K 2c 2K 26 2K 2K OK 2K 2K 2k 2K OK 2K 2k 2k 2K 2K 2K 2 OK 3K 2K 2K OK 2K OK OK 2K OK 2K OK OK OK OK OK OK OK 


-- This procedure traverses the vertices of the graph and calculates the node 


--evaluation, initiation and the total vertex cost. 
RK ROKK oe ee 2 26 2K 2 2 ke 2 2 2K 2K 2 26 2K 2K 2K > OK 2K 2K 2k ke 2K 2k 2K 2k 2K 2K 2K 2k 2K 2K 2K 2 2k 2K 2K 2k 2 2K 2K 2k OK 2K 2k 2K 2K 2K 2k 2K OK 2K OK 2K 6 OK 2K OK OK 


procedure sum_vertices(The_ Vertex : in TEST_GRAPH.VERTEX; 
Continue : out BOOLEAN) is 
temp_item : ITEM; 


begin 
temp_item := TEST_GRAPH.Item_Of(The_vVertex); 
if temp_item.covered then 
vertex_eval_cost := vertex_eval_cost + temp_item.eval_cost; 


else 
vertex_eval_cost := vertex_eval_cost + temp_item.eval_cost; 
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vertex_init_Cost := vertex_init_cost + temp_item.init_cost; 
Eng 11: 
vertex_cost := vertex_eval_cost + vertex_init_cost: 
Continue := True: 
end sum_vertices: 
procedure calculate_vertices_cost 1s new 
TEST_GRAPH.Iterate_Vertices(sum_vertices); 


3 228K OK OK 2K 2K 2K 2K 2K OK 2k 2K 2k ok ok 2k 2K ok ok 2k 36 ok 2 2k 2k ok 2K 26 2 2 2k ok 2k 2k ok ok 2 36 26 9k 2k OK 2k 26 26 8 2k 2 OK 2k 2k 2k 2k 9K 2k 2k 2k 2k 2k 25 ok ok 2k ok ok 6 ok 


-- This procedure traverses the arcss of the graph and calculates the arc cost. 
— 0K 2K 2K OK 2k 2K 2k Ok Ok 26K 2k 2k 2k 2 2K Ok Ok 2k Ok 2k ok ok 0k 2k 2 2k 2k ok 2g 2 2K 2 2 OR 2k 2k 6 ok 0K 2k 2k 2k 2k 2k 2k 2k OK 2k 28 ok 2k 2k 2K 2K ok ok 2k ok 2k ok 2K ok OK KK OK 
procedure sum_arcs(The_Arc : in TEST_GRAPH. Arc: 

Continue : out BOOLEAN) is 


temp_attribute : NAME; 
Dest_ Vertex : VERTEX; 
Dest_Item, 

New_Item : ITEM; 
Vertex_Located : BOOLEAN: 
Changing_Vertex_ID : KEY; 


begin 
temp_attribute := TEST_GRAPH.Attnbute_Of(The_Arc); 
temp_attribute.transitioned := true; 


arc_count := arc_count + I; 
arc_cost := arc_cost + temp_attribute.cost; 


Dest_Vertex := Destination_Of(The_Arc); 
Dest_Item := Item_Of(Dest_ Vertex); 
New_lItem.ID := Dest_Item.ID; 
New_Item.EVAL_COST := Dest_Item.EVAL_COST; 
New_Item.INIT_COST := Dest_Item.INIT_COST; 
New_Item.COLOR | := Dest_Item.COLOR; 
New_Item.COVERED := True; 
TEST_GRAPH.SET_ITEM(Dest_Vertex,New_Item); 
if arc_count = TEST_GRAPH.Number_Of_Arcs_In(A_Graph) then 
are count = (); 
Continue := False; 
else 
Continue := True; 
end if; 
end sum_arcs; 
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procedure calculate_arcs_cost is new 
TEST_GRAPH.Iterate_Arcs(sum_arcs); 


begin --Calculate_Graph_Cost 

if TEST_GRAPH.Number_Of_Arcs_In(A_Graph) = 0 then 

we 1OPUT('n="); 

Print_Current_Vertices( A_Graph): 

new_line: 
end if: 
meecount := 0: 
calculate_arcs_cost(A_Graph); 
calculate_vertices_cost(A_Graph); 
Clear_Covered_Variable(A_Graph); 
eX) IO.PUT(” "): 
NATURAL_IO.PUT(Graph_Count, width => 6): 
ex T_10O.PUTC(' “): 
NATURAL_IO.PUT(TEST_GRAPH.Number_Of_Vertices_In(A_Graph), width => 

6); 

ie <1 1O.PUTC "): 
NATURAL_IO.PUT(TEST_GRAPH.Number_Of_Arcs_In(A_Graph), width => 6); 
eT 1O;PUT(" "): 
FLOAT_INOUT.PUT(vertex_eval_cost.fore => 8.aft => 2,exp => 0); 
mex. 1O.PUT( "); 
FLOAT_INOUT.PUT(vertex_init_cost,fore => 8.aft => 2,exp => 0); 
eT _1O.PUTC ”): 
FLOAT_INOUT.PUT(arc_cost,fore => 8,aft => 2,exp => Q); 
EXT 10.PUTC "); 
graph_cost := vertex_eval_cost + vertex_init_cost + arc_cost: 
FLOAT_INOUT.PUT(graph_cost.fore => 8,aft => 2.exp => 0): 
eT 1O-PUT_line(” "):; 


Graph_Count := Graph_Count + 1; 


end Calculate_Graph_Cost; 
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--This procedure generates a disconnected graph of the input nodes based on the values 
--of the input data. 
= 0K RR OR OK OK OK OK I OG 2 ROK RO OR OK OK OK 2 OC OK OR OIC OI 2 2 OS 2 ok of 2 OI 2 2 2 2g OK OK OI 2g ok OR OK OK OK OK OK ok ok ok OK OK OK OK OK OK ok ok OK OK OK OK KKK KR 
procedure create_disconnected_graph 
(REFERENCE GRAPH  :in out TEST_GRAPH.GRAPH: 
DISCONNECTED_GRAPH : in out TEST_GRAPH.GRAPH) is 
9K 2K OR 2 OK OK OK 2K OK OK OK OK OK OK KK OR OK OK oR 2 OK OK 2 oR OK OI KOK oo OK OK oI 2K ok og OK ok ok oi 2K ROK 2 2K OK 2g oie 2g og 2K OK OK OK OK OK OK OK ok ok ok ok Kk 
--This procedure traverses a REFERENCE GRAPH and adds each node(vertex) to 
-- a working DISCONNECTED GRAPH. 
KR OK OR OK OR og OK OR i oi KK OK Kk kg og OK Og OK OK OR OK OK OR OO OR OK OK OR OK 2 OR OR OK OK 2 OR of 2g RO OI i 2k 2 2g OR OK OR OK OK oO OKO OK OK OK OK OK Ok 
procedure ADD_ALL_VERTICES(THE_VERTEX : in TEST_GRAPH.VERTEX; 
CONTINUE ~ : out BOOLEAN) is 
TEMP_ITEM_ : ITEM; 
TEMP: VERTEX: TESTIGRAPEHEYV ERGEX 


begin 
TEMP_ITEM := TEST_GRAPH.Item_Of(THE_VERTEX); 
TEST_GRAPH.Add(TEMP_VERTEX, TEMP_ITEM,DISCONNECTED_GRAPH); 
CONTINUE := TRUE; 
end ADD_ALL_VERTICES; 
procedure generate_disconnected_graph is new 
TEST_GRAPH.Iterate_Vertices(ADD_ALL_VERTICES); 


begin -- create_disconnected_graph 


TEST_GRAPH.clear(DISCONNECTED_GRAPH); 
GENERATE_DISCONNECTED_GRAPH(REFERENCE_GRAPH); 
end create_disconnected_graph; 


2K aK ok oR oe 2 Ok ok OK ok ok oe oe 2 OK 2G oe 2 2K OK OK oR OK oe 2K 2K ok 2k OK oie ok ok OK oe 2 OK 2k ok Ok oi ok ok ok 2 2 ok oo Ok OK ok OK 2k OK ok ok eK ok Ok KK 


--This procedure searches the input graph to determine the SOURCE and DESTINATION 
--vertices og the graph. 
2 OK OK 2 OK 6 2 2k 2 ok OK oie oe ok OK Ok i 2 oo oe KK OK IG OK oo oie of 2k ok 2 2 2k 2 oi ok 2g 2K OK oe Ko fe ie 2 ok ok ok of 2 ie oi ok ok ok oe Oe ok 
procedure FIND_ARC_POINTS(AN_ARC : in out TEST_GRAPH.ARC; 
A_GRAPH : in out TEST_GRAPH.GRAPH; 
ARC_ATTRIBUTE : in out NAME; 
VERTEX_SOURCE, 
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VERIEXSDES) in on VES MGRAPH VERTEX: 
POINTS_FOUND : out BOOLEAN) is 


SOURCE ITEM. 

DESTITEM <ITEM: 
SOURCE_FOUND. 

iis) SOUND = BOOLEAN := FALSE: 


begin 
ARC_ATTRIBUTE := TEST_GRAPH.Attribute_of(AN_ ARC): 
PeRTEX SOURCE := TEST _GRAPH.Source Of(AN_ARC): 
VERTEX_DEST := TEST_GRAPH.Destination_Of(AN_ARC): 
SOURCE ITEM := TEST_GRAPH Jtem_Of(VERTEX_ SOURCE): 
WEST ITEM <= TEST GRAPH Jtem_Of(VERTEX DEST): 
VERTEX _COMPARE(A_GRAPH.SOUR- 
CE _ITEM.ID,VERTEX_SOURCE.SOURCE_FOUND); 
VERTEX COMPARE(A_GRAPH.DES- 
ieiteM ID.VERTEX_DEST.DEST_FOUND); 
if SOURCE_FOUND and DEST_FOUND then 
EOUNTS FOUND := TRUE: 
else 
POINTS_FOUND := FALSE; 
end if: 


end FIND_ARC_POINTS; 


wn 2 ig hg 2h 2h 2s 2s 2g 2s fe ic ie 2k 2k 2g 2 2k fe of 2h oie oie oie 2s 2s 2h 2k fs 2h fe ie ie 26 2h ik of 2K fe 2k 2s af 2h oie oe oie oie 2 ofc oi of 2k 2k 2s oie 2k oie 2k 2k 2k 2 2k 2c ok 6 ok ok oe ok 


--This procedure determines the arcs of the graph. 
a 2k ig 2h fe fe ic 2c 2k fe fe ofc fe of 2k afc ois ic afc 2s ofc of of ois 2k oie of 2s of 2c oie ofc afc afc oi ie ofc ofc 242i 2s ofc oie of ofc fs 26 oe 2 ic afc 2 fs ofc oie akc of fs oe ofc oi of oie ik ofc 2 ie ok 
procedure BUILD_ARC_LINK_LIST 
(WORKING_GRAPH, 
FULL_GRAPH — : in out TEST_.GRAPH.GRAPH; 
ARC_LINK_LIST : in out LINK) is 


ATTRIBUTE : NAME; 

SOURCE, 

DESTINATION : TEST_GRAPH. VERTEX; 
NEW_ARC ; FEST_GRAPH.ARC, 


ARC_POINTS_FOUND, 
ARC_MATCH_MADE : BOOLEAN; 


oo KK oR 2 RK ee OR eK oe og OK go RK OK 2K 2 6 OR oe 2 2 ok 2 2 2 fe oe 2k 2k ie 2c 2 8 OR og 2 2 28 2K 8 2 28 OR 28 OR 28 OK OK OR 2k 2k 2k 2K OK OK ok 


--This procedure traverses the arcs in the graph to determine the arcs in the graph. 
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procedure BUILD_LIST(THE_ARC : in TEST_GRAPH.ARC; 
CONTINUE : out BOOLEAN) is 


AN_ARC : TEST GRAPH ARC =THEVARE: 
begin 
ATTRIBUTE := TEST_GRAPH.Attribute_Of(AN_ARC): 


FIND_ARC_POINTS(AN_ARC,.WORKING_GRAPH.ATTRIBUTE, 


SOURCE.DESTINATION,ARC_POINTS_FOUND); 
if ARC_POINTS_FOUND then 


ARC_COMPARE(WORKING_GRAPH,.SOURCE.DESTINATION, 


ATTRIBUTE.NEW_ARC,ARC_MATCH_MADE), 
if not ARC_MATCH_MADE then 


ARC_LIST.INSERT_END(ARC_LINK_LIST, THE_ARC); 
end if: 
end if: 
CONTINUE := TRUE; 
end BUILD_LIST; 


procedure CREATE_ARC_LIST is new TEST_GRAPH Iterate_Arcs(BUILD_LIST); 


begin —_-- build_arc_link_list 
CREATE_ARC_LIST(FULL_GRAPH); 


end BUILD[ARC2EINKSUIS TE 


WK OR RK KK oR 2 OR KOK oR 2K 2 oe ok oe ok 2 ok 2 ok oe 2 ok 2 2 ok eo 2 oo ok ie 2K ok 2 ke oe 2K 2 Oe 2 OK 2 2K KK 2 OK OK KK Ok OK 


--This is the main procedure in the working package. This procedure is the driver to 


--generate and calculate the cost of each combination of graphs based on the input set. 
Wo OK RK RK 6 2 6 6 ie ie 2 2K oe 2k 2K 2K KK 2K OK 2 Ok 2 OK Ko 2K 2k oe oie 2 oe 2 2 ok 2k 2K 2K kK 8 2 eK 2 ok ok ok oo KK 2k ok ok KK KK 
procedure generate_all_graphs_and_costs is 


-- A_GRAPH is a graph of the important nodes. 
-- FULL_GRAPH is a graph of all nodes and arcs. 
-- WORKING_GRAPH starts as a graph of all nodes only. 


FILE_NAME : STRING(1..80) := (others => ''); 
LAST : INTEGER; 
ARC_COUNT : NATURAL := 1; 


WORKING_GRAPH : GRAPH; 
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-- This is the internal calling procedure to calculate the cost of each possible graph 


--reachable based on the input set. 
~ 78 RR RK 2k 2k 2k Ok Ok KK Ok kk kk RK ok KK kk ok kok aK a a kk kk ok aR kk ok kok kk kok KK kok kK 


procedure CALC_ARCS(ARC_LINK_LIST : in out ARC_LIST.LINK: 
WORKING_GRAPH : in out TEST_GRAPH.GRAPH) is 


a aR RR 2 OK OK OR OK 2K 2K 2 ok i 2 ok i oi 2 2g 2K ok 2 2 2K 2 2 2K 2K 2k 2k 2K ok 2 OK ok 2k 2K 2k 2K 2k 2k 2k 2k 2k 2k ok ok 2k ok 2k 2k ok ok ok 2k ok ok ok ok ok ok kK 


--This procedure Adds and arc to the graph. It first determines if the Source and 


--Destination are present. 
wn KK 2K 2 2 2 2K 2K OK 2 og 2 2 2k 2k 2k 2k 2k 2k 2k 2k 2k 2k 2k ok 2k 2 fe 2k 2k 2k 2K ok ok ok ok ok ok of of 2k 2k ok ok ok ok 2 2k 2k ok 2k ok 2k ok 2k ok ok ok ok 2k ok ok 2k ok KK 
procedure ADD_ARC(AN_ARC LIST: in out ARC_LIST.LINK: 

TEMP_GRAPH : in out TEST_GRAPH.GRAPH) is 


TEMP_ARC : TEST_GRAPH.ARC; 
ATTRIBUTE : NAME: 
SOURCE, 


DESTINATION — : TEST_GRAPH.VERTEX; 
ARC_POINTS_FOUND, 
ARC_MATCH_MADE : BOOLEAN := FALSE; 


begin 
TEMP_ARC := AN_ARC LIST.INFO; 
FIND_ARC_POINTS(TEMP_ARC.TEMP_GRAPH,ATTRIBUTE,SOURCE. 
DESTINATION, ARC_POINTS_FOUND); 

if ARC_POINTS_FOUND then 

ARC_COMPARE(TEMP_GRAPH,SOURCE,DESTINATION, ATTRIBUTE, 
TEMP_ARC,ARC_MATCH_MADE); 

if not ARC_MATCH_MADE then 


TEST_GRAPH.Create(TEMP_ARC,ATTRIBUTE,SOURCE,DES TINATION,TEMP_G 
RAPH); 
end if; 
end if; 
end ADD_ARC; 


67 


Appendix B 


ook KK 2K 2 2K OK ok 2K 2K OK 2K OK 2 OK OK 2 2k 2k 2k 2 2K 2k 2K 2K 2K 2 2k 2K 2K 2K 2K 2K OK OK OK 2K 2K OK 2K 2K 2K 2K 2K OK OK OK OK ok KK 2K 26 2k ok ok ok OK OK 2k ok OK ok ok ok 


--This procedure deletes the arcs of a graph. This procedure is used after the 

--graph calculations are completed. prior to adding another node to the working 

--graph. 

_ 2K 2 OK 2k 2K OK ok OK 2 2k 2K 2K 2K 2k ok 2k 2k ok 2K 2k OK 2k 2K OK 2K 2K 2 OK 2k 2k 26 2K 2k ok 2K 2k OK 2k 2k ok 2K 2 OK 2K 2k OK OK ok ok 2 2K ok 2k OK 2K OK ok OK KK ok OK ok OK KK 

procedure DEL_ARC(ARC_LIST_HEAD : in out ARC_LIST.LINK: 
TEMP_GRAPH © : in out TEST_GRAPH.GRAPH) is 


TEMP_ARC : TEST_GRAPH.ARC; 
ATTRIBUTE : NAME; 
SOURCE, 


DESTINATION — : TEST_GRAPH.VERTEX; 
ARC_POINTS_FOUND., 
ARC_MATCH_MADE_ : BOOLEAN := FALSE; 


begin 
TEMP_ARC := ARC_LIST_HEADINEG: 
FIND_ARC_POINTS(TEMP_ARC.TEMP_GRAPH.ATTRIBUTE,SOURCE, 
DESTINATION,ARC_POINTS_FOUND); 

if ARC_POINTS_FOUND then 

ARC_COMPARE(TEMP_GRAPH,SOURCE,DESTINATION,ATTRIBUTE, 
TEMP_ARC,ARC_MATCH_MADE); 
if ARC_MATCH_MADE then 
TEST_GRAPH.Destroy(TEMP_ARC,TEMP_GRAPH); 

end if; 

end if; 

end DEL_ARC; 


begin -- CALC ARCS 

if ARC_LINK_LIST /= null then 
ADD_ARC(ARC_LINK_LIST, WORKING_GRAPH)); 
CALCULATE_GRAPH_COST(WORKING_GRAPH); 
CALC_ARCS(ARC_LINK_LIST.NEXT, WORKING_GRAPH); 
DEL_ARC(ARC_LINK_LIST, WORKING_GRAPH); 
CALC_ARCS(ARC_LINK_LIST.NEXT, WORKING_GRAPH); 
end if; 


end CALC_ARCS; 
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--This procedure traverses the vertices of the graph. 
nA he 28 2 ie 2 ie 2c 2 2 2k 2 2 2 2k 2k ok oe fe og 2c 2c oe 2g oie ok 2k ok ok ok fe 2k ok ok ok 2k ok 2k 2k ok ok 2k ok ok ok ok ok ok ok ok ok ok ok ak ok ak ok kok ok de kook kek ok 
procedure traverse_vertices( The_ Vertex : in VERTEX: 
CONTINUE. : out BOOLEAN) is 


TEMP_VERTEX, 

FOUND_VERTEX : VERTEX: 
TEMP_ITEM~ : ITEM: 
VERTEX_FOUND : BOOLEAN := false: 


begin 
TEMP_ITEM := TEST_GRAPH.ITEM_OF(THE_VERTEX), 
VERTEX_COMPARE(WORKING_GRAPH.TEMP_ITEM.ID, 


FOUND_VERTEX,VERTEX_FOUND); 
if not VERTEX_FOUND then 


TEST_GRAPH.Add(TEMP_VERTEX,TEMP_ITEM.WORKING_GRAPH); 
ine ssi Clear THE_ARC LIST); 
CALCULATE_GRAPH_COST(WORKING_GRAPH); 
-- working graph starts with only the important nodes. 
BUILD_ARC_LINK_LIST(WORKING_GRAPH, FULL_GRAPH, 
THE ARGSEIST): 

CALC_ARCS(THE_ARC_LIST, WORKING_GRAPH); 

end if; 

if TEST_GRAPH.Number_Of_Vertices_In(WORKING_GRAPH) = 


TEST_GRAPH.Number_Of_Vertices_In(FULL_GRAPH) then 
CONTINUE := FALSE; 


else 
CONTINUE <= TRUE: 
end if; 
end traverse_vertices; 
procedure Vertex_Traversal is new 
TES T_GRAPH._Iterate_Vertices(traverse_vertices); 


begin -- generate_all_graphs_and_costs. 


TEST_GRAPH.CLEAR(FINISH_GRAPH); 
TEST_GRAPH.CLEAR(WORKING_GRAPH); 


CREATE_DISCONNECTED_GRAPH(FULL_GRAPH, FINISH_GRAPH); 
-- FINISHED GRAPH is a graph of all nodes. 
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TEST_GRAPH.Copy(IMPORTANT_GRAPH, WORKING_GRAPH): 

-- for starting important graph. 
CALCULATE_GRAPH_COST(WORKING_GRA PH): 
BUILD_ARC_LINK_LIST(WORKING_GRAPH. FULL_GRAPH, 

THESARC EIST): 

CALC_ARCS(THE_ARC_LIST, WORKING_GRAPH); 
ARC_LIST.Clear(THE_ARC_LIST); —-- Starting Graph has been completed 


-- for remainder of the graph. 


VERTEX_TRAVERSAL(FULL_GRAPH);  -- A vertex traversal of the graph 
-- having all nodes and arcs. 


end generate_all_graphs_and_costs: 


end GRAPH_WORKS; 
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APPENDIX C: Graph Package Specification 


with Set_Package; 
generic 
type Item _is private; 
type Attribute is private; 
package Graph_Package is 


type Graph is limited private: 
type Vertex is private; 
type Arc is private: 


Null_ Vertex : constant Vertex: 
Null_Arc : constant Arc: 


procedure Copy (From_The_Graph :in Graph; 
To_The_Graph _ : in out Graph); 

procedure Clear (The_Graph : in out Graph); 

procedure Add (The_Vertex : in out Vertex; 
With_The_Item :in Item; 
To_The_Graph : in out Graph); 

procedure Remove (The_ Vertex :1n out Vertex; 
From_The_Graph — : in out Graph); 

procedure Set_Item (Of_The_Vertex  : in out Vertex; 
Tosihesitem sin) Item); 

procedure Create (The_Arc : In out Arc; 
With_The_Attribute:in Attribute; 
From_The_Vertex  : in out Vertex; 
To_The_Vertex :in Vertex; 
In_The_Graph : in out Graph); 


procedure Destroy (The_Arc >in out Arc; 
In_The_Graph — : in out Graph); 
procedure Set_Attribute (Of_The_Arc : in out Arc; 
To_The_Attribute :in Attribute); 
function Is_Empty (The_Graph :in Graph) return Boolean; 
function Is_Null (The_Vertex : in Vertex) return Boolean; 
function Is_Null (The_Arc :inArc) return Boolean; 


function Number_Of_Vertices_In (The_Graph :in Graph) return Natural; 
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function Number_Of_Arcs_In (The Graph :in Graph) return Natural: 
function Number_Of_Arcs_ From (The_Vertex : in Vertex) return Natural: 


function Item_Of (The_Vertex : in Vertex) return Item: 
function Attribute_Of (The_Arc :in Arc) return Attribute: 
function Source_Of (The_Arc :in Arc) return Vertex; 
function Destination_Of (The_Arc  :in Arc) return Vertex: 
function Is_A_Member (Then Ventex ss Ine vertex 

Of_The_Graph : in Graph) return Boolean; 
function Is_A Member (ThezArc aineeunc: 


Of_The_Graph : in Graph) return Boolean; 


generic 
with procedure Process (The_Vertex : in Vertex: 
Continue : out Boolean); 
procedure Iterate_Vertices (Over_The_Graph : in out Graph); 


generic 
with procedure Process (The_Arc : in Arc; 
Continue : out Boolean); 
procedure Iterate_Arcs (Over_The_Graph : in out Graph); 


generic 
with procedure Process (The_Arc : in Arc; 
Continue : out Boolean); 
procedure Reiterate (Over_The_ Vertex : in Vertex); 


Overflow exceprlone 
Vertex_Is_ Null : exception; 
Vertex_Is_Not_In_Graph : exception; 
Vertex_Has_References : exception; 
Arc_Is_ Null : exception; 
Arc_Is_Not_In_Graph : exception; 


private 

type Vertex_Node; 

type Vertex is access Vertex_Node; 

package Vertex_Set is new 
Set_Package(Item => Vertex); 

type Arc_Node; 

type Arc is access Arc_Node; 

package Arc_Set is new 
Set_Package(Item => Arc); 

type Graph is 


12 


Appendix C 


record 
The_Vertices : Vertex_Set.Set: 
OhesArcs "Arc Set.Sct: 
end record: 
Null_ Vertex : constant Vertex := null: 
MulleAre = constant Arc := null: 
end Graph_Package: 


generic 

type Domain is private; 

type Ranges Is private; 

Number_Of_Buckets : in Positive: 

with function Hash_Of (The_Domain : in Domain) return Positive: 
package Map_Package is 


type Map is limited private: 


procedure Copy (From_The_Map :in Map; 
To_The_Map_ : in out Map); 
procedure Clear (The_Map _ : in out Map); 
procedure Bind (The_Domain :in Domain; 
And_The_Range:in Ranges; 
In_The_Map_- : in out Map); 
procedure Unbind (The_Domain :in Domain; 
In_The_Map_ : in out Map); 


function Is_Equal (Left —: in Map; 
Right —: in Map) return Boolean; 
function Extent_Of (The_Map_- : in Map) return Natural; 
function Is_Empty (The_Map_ : in Map) return Boolean; 
function Is_Bound (The_Domain : in Domain; 
In_The_Map : in Map) return Boolean; 
function Range_Of (The_Domain : in Domain; 
In_The_Map : in Map) return Ranges; 


generic 
with procedure Process (The_Domain : in Domain; 
The_Range : in Ranges; 
Continue : out Boolean); 
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procedure Iterate (Over_The_Map : in Map); 


Overtlow exception, 
Domain_Is_Not_Bound : exception: 
Multiple Binding : exception: 


private 

type Node: 

type Structure is access Node; 

type Map is array (Positive range | .. Number_Of_Buckets) of Structure: 
end Map_Package; 


generic 
type Item is private; 
package Set_Package is 


type Set is limited private: 


procedure Copy (From_The_Set:in Set; 
To_The_Set : in out Set); 
procedure Clear (ThesSet” © inoue set): 
procedure Add (The_Item :in_ Item; 
Tol ihe Set). am Out set): 
procedure Remove (The_Item :in Item: 
From_The_Set : in out Set); 
procedure Union (Of Thesset= new Scr 
And_The_Set :in_ Set; 
To_The_Set : in out Set); 
procedure Intersection (Of_The_Set :in Set; 
And_The_Set :in Set 
To_The_Set : in out Set); 
procedure Difference (Of_The_Set :in Set; 
And_The_Set :in Set; 
To_The_Set : in out Set); 


function Is_Equal (Left : in Set; 

Right :in Set) return Boolean; 
function Extent_Of (The_Set :in Set) return Natural; 
function Is_Empty (The_Set :in Set) return Boolean; 
function Is_A_ Member (The Item = in item: 
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Of_The_Set: in Set) return Boolean: 


function {[s_A_ Subset (Rettw =.) in Set: 
Right  :in Set) return Boolean: 
function is_A_Proper_Subset (Lett Pim Set; 
Right  :in Set) return Boolean: 
generic 


with procedure Process (The_Item : in Item: 
Continue : out Boolean); 
procedure Iterate (Over_The_Set : in Set); 


Overtlow > exception: 
item Is_In_Set + exception; 
Item_Is_Not_In_Set : exception: 


private 

type Node; 

type Set is access Node; 
end Set_Package; 
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FILENAME 
ability.2f 


okealeslt 


borders.2f 


centerpt.1f 


concurrent. lf 
constBatt. lf 


contproc.2f 


cumulative. lf 
destrolle.lf 


diffupdates. If 


emax. If 


fcalc.2f 


Appendix D 


APPENDIX D: Program Variable Aggregates 


ID 
6 


45 


42 


10 


3] 


36 


none 


AGGREGATES 


ability (13) 
multiaction 
smallaction 


bkcalk (47) 


borders (20) 
whenborders 


centerpt 
evenrows 


concurrent (108) 


constBatt (10) 
contproc (59) 
OffQueue 
HighFirstOffQ 
cumulative 


destrolle (38) 


diffupdates 
diffinc (15) 


emax (62) 
fcalc (48) 
nfmod 


fnocas (49) 
sumfmn (50) 
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hone 


34 


12, 16, 32340 
1 


4] 


none 


FILENAME 
function. If 
Heightcond. lf 
Hegtcondzero. lf 
infrd.2f 
kamod. lf 


kfzero.2f 


minarmmy. | f 


mostweapons.2f 


neednewaxy. lf 
nkmod.2f 
nofmdfire. lf 
noobs. If 
noobsnoatter.5f 
notargnofire. 1f 
nsmod.2f 


numrange. lf 
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ID AGGREGATES SEQUENCING 


~+ 


none 


2» 


30 


HD 


20 


30.5 


38 


function 
Heightcond (23) 
hgtcondzero (24) 
infrd 

kamod (30) 
kfzero (29) 
kpzero 


TooFar (81) 


minarmy (7) 
minBatt 


mostweapons (33) 


mosttargets (34) 


notjustonetarg (36) 


neednewaxy (35) 
nkmod (31) 
nofrmndfire (12) 


noobs (51) 


noobsnoatter (28) 


notargnofire (37) 
nsmod (54) 


numrange (14) 


Ti 


Lops 


[5216 


WO) ae: 
FO 27 ee 
Ft 
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FILENAME ID AGGREGATES SEQUENCING 
outarmytoBatt. | f outarmytoBatt (8) l 


I 


procdest.2f 43 procdest (60) +] 


reptinc. lf +] reptinc (25) 40 
reptexpire (26) 
reptobscont 
reptreptconf 
reptuse (78) 


reptmdef.2f 40 reptmdef (51) 38 
whenrept (52) 
reptdest (53) 
commdes (55) 
Scomm (56) 
Srept (57) 
ImpleMess (61) 
CommDelay (102) 


simpos. lf $5) simpos (16) G5 Ne 
simulationduration.2f 1 simulationduration (2) none 


durationname (3) 
Durationrange (65) 


solidterrain.2f Ie: solidterrain (6) 1, 70 
whenmove (17) 
srmin.2f Id srmin (22) none 
terrweaeffect.2f 21 terrweaeffect (5) 12, 70, 69 
umod.3f 28 umod (39) i! 
destrbatt (40) 
AllBatts (11) 
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FILENAME ID AGGREGATES SEQUENCING 
vecalc.2f 14 vecale (19) 12. 70 
whenvg 
whenattnit. 1f a2 whenattrit (27) l 
nointerattrit 
whenku.2f DF whenku (32) 26 
whenobs. lf 16 whenobs (21) l 
whenRD. If 39 whenRD l 
mesgRD 
whenrest.2f sii whenrest (41) 34, 36 
Dstmotcas (44) 
ETooHigh (45) 
NolongerCAS (58) 
CASFixed (46) 
zeroduration.2f 3 zeroduration (4) 2 
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APPENDIX E: Input Data Sets 


DATA_SET_ONE 


suspicious 0 0.00 0.00 

suspicious | 26.00 9.00 

suspicious 2 36.00 32.00 
important 3. 4.00 17.00 

important 4 768.00 16.00 
suspicious 5 42.00 26.00 
important 6 30.00 13.00 
important 7 225.00 41.00 
suspicious 8 40.00 17.00 
suspicious 9 90.00 33.00 
important 10 101.00 55.00 
important 11 20.00 41.00 
important 12 221.00 76.00 
important 13 54.00 64.00 
important 14 210.00 37.00 
suspicious 15 114.00 26.00 
important 16 100.00 32.00 
suspicious 17 126.00 12.00 
important 18 46.00 7.00 


TEST O07 9 00m 
TEST 12 155,002 
TEST 21472 =>. 0004 
TESTASs is O03 
TEST 1G) 157.006 
TESTU eS 00 
TEST 910° 9 21-0010 
TEST 17°1533:007 
TEST 15 114005 
TEST 512 5 44.00 12 
TEST Sie 20001 
TEST 18 1 8.008 
TEST 315267 7-005 
TEST 151615 5.00iG 
TEST 513;5 30.0013 
TEST Aly? 3.00r 
TEST 1718 17 7.00 18 
TEST 14 1 13.00 4 
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suspicious 0 0.00 0.00 

important | 26.00 9.00 

suspicious 2 36.00 32.00 
suspicious 3. 4.00 17.00 

suspicious 4 768.00 16.00 
important 5 42.00 26.00 
suspicious 6 30.00 13.00 
suspicious 7 225.00 41.00 
important 8 40.00 17.00 
important 9 90.00 33.00 
suspicious 10 101.00 55.00 
suspicious 11 20.00 41.00 
suspicious 12 221.00 76.00 
suspicious 13 54.00 64.00 
suspicious 14 210.00 37.00 
suspicious 15 114.00 26.00 
suspicious16 100.00 32.00 
suspicious 17 126.00 12.00 
suspicious 18 46.00 7.00 


TEST O1 0 9/001 
TEST 121 55:00 
TEST 214 2 5.00 14 
TESTE 1395s. 006 
TEST 167 157 U0kG 
TEST 09" 0337009 
TEST 91G>9 2120010 
TEST AT sie 00, 
TEST 15° Bl4 005 
TEST 512 5 44.00 12 
TEST SiS 12200 enl 
TEST 18 1 8.008 
TEST $153 720015 
TEST SG is >: 008 
TEST 313 S000 
TEST 7 Mes 00a7 
TEST 1718 17 7.00 18 
TEST 14 1 13.00 4 
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DATA_SET_THREE 


important 0 (0.00 0.00 

important | 26.00 9.00 

suspicious 2 36.00 32.00 
suspicious 3. 4.00 17.00 

suspicious 4 768.00 16.00 
suspicious 5 42.00 26.00 
suspicious 6 30.00 13.00 
suspicious 7 225.00 41.00 
suspicious 8 40.00 17.00 
important 9 90.00 33.00 
suspicious 10 101.00 55.00 
suspicious 11 20.00 41.00 
suspicious 12 221.00 76.00 
suspicious 13 54.00 64.00 
Suspicious 14 210.00 37.00 
suspicious 15 114.00 26.00 
suspicious16 100.00 32.00 
suspicious 17 126.00 12.00 
Suspicious 18 46.00 7.00 


GEST O! O 9.001 
Meeli2 | 55.00 2 
TEST 214 2 5.00 14 
MEST 13 1 8.003 
ZEST 16 | 7.006 
est 09 0 33.009 
est 910 921.00 10 
esti? | 33.007 
mesh is 1 14.005 
MEST 512 5 44.00 12 
Mest 511 5 12.00 11 
MEST 18 1 8.008 
Mest sls 8 7.00 15 
MEST 1516 15 5.00 16 
iol 513 5 30:00 13 
Mest 117 1 3.00 17 
TEST 1718 17 7.00 18 
TEST 14 1 13.00 4 
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DATA_SET_FOUR 


important 0 0.00 0.00 

important 1 26.00 9.00 

suspicious 2 36.00 32.00 
suspicious 3. 4.00 17.00 

suspicious 4 768.00 16.00 
suspicious 5) 42.00 26.00 
suspicious 6 30.00 13.00 
suspicious 7 225.00 41.00 
suspicious 8 40.00 17.00 
important 9 90.00 33.00 
suspicious 10 101.00 55.00 
suspicious 11 20.00 41.00 
suspicious 12 221.00 76.00 
suspicious 13 54.00 64.00 
suspicious 14 210.00 37.00 
suspicious 15 114.00 26.00 
suspicious 16 100.00 32.00 
suspicious 17 126.00 12.00 
suspicious 18 46.00 7.00 
suspicious 19 96.00 42.00 


TEST O17 079:00)1 
ES Tee i ile55.00'2 
MEST 21422 5:00 14 
TEST 13771800 3 
TEST 16 1 7.006 
TEST 097 0'33,00:9 
TEST SIN 9210010 
TEST 14 1 13.004 
TEST 15 1 14.005 
TESTA 2133:00'7 
TESS lies 12:00 11 
TESTS 2 5144.00 12 
TEST 3952000713 
AES el Sols 008 
PEST sss. 7.00/15 
TEST 1516.15'5.00 16 
PES tele 7ls 3.0017 
TEST 117 1 3.00 17 
TEST 718 17 7.00 18 
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DATA_SET FOUR 


TEST 188 18 8.00 8 
TES ei oa One 
TEST 1819138°3:0¢ 13 
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APPENDIX G: Scheduling Tool Output Data 


C{init) c(test) 
Num_Grapns nds/are min max mean std dev min max mean std_ dev min 
no «= 18 16 14 13: 12 11 10 7 > Gi 9453") (Evalsicose s-= 977:9.00)) 
al. —abaly/Ie. 3990 9950 399.0 0.0 0.0 0.0 0.0 Ono 2178.0 
Tots 0 399.0 399.0 399.0 0.0 0.0 9.0 2} 50) 0.0 2178.0 
n= 0 V8) Fe 14° 13> 12 2 10) 7 G6) 45 Se Eval Costas ea791010)) 
tO ee sO 399.0 399.0 39/9/50 0.0 a0 0.0 0.0 0.0 2178.0 
Tots iG 3990s 290 399.0 0.0 9.0 0.0 0.0 0.0 2178.0 
n= J O 28 5le 14513 12 27 107557596) 45) soe tEvals Cost 3:39 1.80/5-,00)) 
0) esi/0 408.0 408.0 408.0 0.0 0.0 eo) 5) oO 0.0 7AAN EVE) 
530 lass 1 367.0 399.0 Sheteiot) — olalag! Yo) Ss} (0) 14.0 Det 2204.0 
Ole Og 0S! /ane 2 350 0) 38.610 T1696 ane IS }o 9) 46.0 28.0 se) 2196.0 
HOROm els /e3 334.0 370.0 350K 4 3.8) 24.0 Be} 4 (0) 42.0 11.9 2190.0 
So 0n 3/4 SVaSe) Sie a (6) SEG 7) Biboe! 37.0 63.0 56.0 So U 2187.0 
We Omeels7) 9 312-20) 322.0 S120 0.0 70.0 70.0 70.0 0.0 2187.0 
Tots 31250 312.0 408.0 360.0 24.9 0.0 70.0 B316.0 V9 1 2187720 
n= 2 21 018 16 14 13) 22 27/207 7) 674) 35 thval) Costes 8400) 
O47 0 440.0 440.0 440.0 0.0 0.0 0.0 0.0 0.0 2281.0 
7.0 14/ 1 399.0 431.0 416.4 11.8 S10 25) 18.6 livin 2249.0 
21.0) 147 2 362.0 418.0 39259 Sea L220 88.0 SlH/5 a iret 2240.0 
a5. 0mel 4/3 330.0 402.0 oe) 35 7/ 200 OO S5iew) 24.4 2232.0 
35.0 14/ 4 SHO ess a0 34 Sele Gre 29.0) 110R0 74.3 24.4 2226.0 
ree] a7) 297.50" 353). 0 s\rie th  aleigd! 42.0 118.0 92.9 Z2ied P3735) (0) 
7.0 14/ 6 284.0 316.0 29865 118 Yeo) Ayal) 711.4 TSE! 2223.0 
Vo 14/7 Peis) een 2751.0 0.0 TSOP OMS 00 130.0 0.0 2246.0 
Tots 12850 275.0 440.0 ebivae: achat) 0.0 130.0 65.0 8168) 22230 
ne S 2 2 0 18 16 14 Wa L212) 10 92 Sera sie Evalnicostr 883700) 
LeOs 315/10 466.0 466.0 466.0 0.0 0.0 0.0 0.0 0.0 2349.0 
eles Open eol/ane 390.0 457.0 4322 9 20e3 Sed) Feo) 209 iGerzZ Asal soe 
Sin Ol lis/, a2 326.0 444.0 398.4 27.2 12.0 99.0 41.8 ate 2283.0 
L6S=200 S73 285.0 428.0 364.5 31.4 20 Ome s 20 62.7 25510 7a (0 
330.0) 15/ 4 244.0 411.0 339057 33.9 29.0 162.0 83.6 75 thes 10) 2222720 
462.0 15/5 207-0) 38/5210 296.9 35.1 41.0 176.0 104.5 28.0 2210.0 
462.0 15/ 6 LTO 39310 263510 Sie 54.0 189.0 2 Sia 28.0 2201.0 
S302 08 5/7 149.0 316.0 229s Sia o Mei)  7Aeal ote) 146.4 20 2119320 
LGo.On 15/ <8 Meese) wagerale) E952 Sis 4 98.0 210.0 Ie Ge) 2500 28710 
55.0 15/9 116.0 234.0 Ul eS 2a ele) au ole 188.2 bes 2184.0 
10 VS/10 103.0 170.0 12758 20-3 wy Sia 274) 68) 209.1 16.2 2184.0 
WO LS aL. 94.0 94.0 94.0 0.0 230 30023050 230.0 0.0 2207.0 
Tot: 20.4'8:0 94.0 466.0 280.0 65.4 0.05 230/70 115.0 43.8 2184.0 
n= 8 S&S 2 1 0 18 Vo a4 13 V2 2 100 796 4 3 lEvaleCoste i939 23100) 
0 1567 20 483.0 483.0 483.0 0.0 0.0 0.0 0.0 0.0 2406.0 
L250) 16/7. 2 407.0 474.0 450.6 20.0 5.0 59.10 19.8 Sie EL UPA 6 (0) 
66.0 16/ 2 343.0 461.0 418.2 26.9 12710 99.0 39.7 21.4 2340.0 
22050) 6/7 3 302.0 445.0 TES Ses es 20/0 siz. 0 59/25 24.9 2308.0 
495.0 16/ 4 261.0 428.0 S533) 3/4'.0 28.0 162.0 7963 2d 2279.0 
1920 16/5 224.0 411.0 32059) 35.0 317 ON 767.0 99.2 Zor 2267.0 
924.0 16/ 6 192.0 385).0 29855) Ont 49.0 189.0 119.0 28.7 2258.0 
792.0 16/ 7 166.0 353.0 256.1 35.6 62.0 201.0 138.8 28s 2249.0 
495.0 16/ 8 149.0 316.0 223.7 34.0 760 se210R0 C58 your: 7k 2241.0 
220.0 16/ 9 13250) 27550 197..3 7313 106.0 218.0 TGS) 24.9 Pye \>) 650) 
66.0 16/10 116.0 234.0 198.8 26.9 VS9 0 22650 198.3 21.4 2232.0 
12.0. T6711 103.0 170.0 126.4 20.0 aelGle) zz} 0) 218.2 ere) 2232.0 
V0 116/12 94.0 94.0 94.0 0.0 238.0 238.0 238.0 0.0 225570 
Tot: 4096.0 94.0 483.0 288.5 65.9 0.0 238.0 119.0 44.0 2232.0 
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c (total) 
max 


2178.0 
217 820 


ZT © 
2178.0 


22s 
2213.0 
2210.0 
2204.0 
2196.0 
2187.0 
2213.0 


2281.0 
2304.0 
2304.0 
2301.0 
2295.0 
2287.0 
2278.0 
2246.0 
2304.0 


2349.0 
BU An (0 
2372.0 
2369.0 
2363.0 
PACE) 5 [0) 
2346.0 
2334.0 
2305.0 
2273.0 
2241.0 
2207.0 
2372.0 


2406.0 
2429.0 
2429.0 
2426.0 
2420.0 
2412.0 
2403.0 
2394.0 
2382.0 
742 }2)\,[0) 
2321.0 
2289.0 
2255.0 
2429.0 


mean 


2178.0 
2178.0 


2178.0 
NTE! (2) 


2213.0 
2207.8 
2202.6 
2197.4 
2192.2 
ZAI 7) (0) 
2200.0 


2281.0 
2276.0 
2271.0 
2266.0 
2261.0 
2256.0 
2251.0 
2246.0 
22635 


2349.0 
2336.1 
232 sie 
2310-3 
2297.4 
2284.5 
AAT dke S) 
2258.6 
2245.7 
PAPE? 3c {2] 
2220.0 
220710) 
2278.0 


2406.0 
2393.4 
2380.8 
2368.3 
BEE) UT 
2343.1 
2330.5 
PENG gE 
2305.3 
2292.8 
2280.2 
2267.6 
2255.0 
2330.5 


std_dev 


0.0 
16.7 
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